{"id":18387,"date":"2024-08-08T17:55:51","date_gmt":"2024-08-08T16:55:51","guid":{"rendered":"https:\/\/telecomkh.info\/?p=18387"},"modified":"2024-08-08T17:55:51","modified_gmt":"2024-08-08T16:55:51","slug":"nvidia-accelerates-humanoid-robotics-development","status":"publish","type":"post","link":"https:\/\/telecomkh.info\/?p=18387","title":{"rendered":"NVIDIA accelerates humanoid robotics development"},"content":{"rendered":"

Developers gain access to new NVIDIA NIM microservices for robotics simulation in Isaac Lab and Isaac Sim, OSMO robot cloud compute orchestration service, teleoperated data capture workflow and more<\/strong><\/p>\n

To accelerate humanoid development on a global scale, NVIDIA announced it is providing the world\u2019s leading robot manufacturers, AI model developers and software makers with a suite of services, models and computing platforms to develop, train and build the next generation of humanoid robotics.
\nAmong the offerings are new NVIDIA NIM™ microservices and frameworks for robot simulation and learning, the NVIDIA OSMO orchestration service for running multi-stage robotics workloads, and an AI- and simulation-enabled teleoperation workflow that allows developers to train robots using small amounts of human demonstration data.
\n\u201cThe next wave of AI is robotics and one of the most exciting developments is humanoid robots,\u201d said Jensen Huang, founder and CEO of NVIDIA. \u201cWe\u2019re advancing the entire NVIDIA robotics stack, opening access for worldwide humanoid developers and companies to use the platforms, acceleration libraries and AI models best suited for their needs.\u201d<\/p>\n

Accelerating Development With NVIDIA NIM and OSMO<\/strong>
\nNIM microservices provide pre-built containers, powered by NVIDIA inference software, that enable developers to reduce deployment times from weeks to minutes. Two new AI microservices will allow roboticists to enhance simulation workflows for generative physical AI in NVIDIA Isaac Sim™, a reference application for robotics simulation built on the NVIDIA Omniverse™ platform.
\nThe MimicGen NIM microservice generates synthetic motion data based on recorded teleoperated data from spatial computing devices like Apple Vision Pro. The Robocasa NIM microservice generates robot tasks and simulation-ready environments in OpenUSD, a universal framework for developing and collaborating within 3D worlds.
\nNVIDIA OSMO, available now, is a cloud-native managed service that allows users to orchestrate and scale complex robotics development workflows across distributed computing resources, whether on premises or in the cloud.
\nOSMO vastly simplifies robot training and simulation workflows, cutting deployment and development cycle times from months to under a week. Users can visualize and manage a range of tasks \u2014 like generating synthetic data, training models, conducting reinforcement learning and implementing software-in-the-loop testing at scale for humanoids, autonomous mobile robots and industrial manipulators.<\/p>\n

Advancing Data Capture Workflows for Humanoid Robot Developers<\/strong>
\nTraining foundation models for humanoid robots requires an incredible amount of data. One way of capturing human demonstration data is using teleoperation, but this is becoming an increasingly expensive and lengthy process.
\nAn NVIDIA AI- and Omniverse-enabled teleoperation reference workflow, demonstrated at the SIGGRAPH computer graphics conference, allows researchers and AI developers to generate massive amounts of synthetic motion and perception data from a minimal amount of remotely captured human demonstrations.
\nFirst, developers use Apple Vision Pro to capture a small number of teleoperated demonstrations. Then, they simulate the recordings in NVIDIA Isaac Sim and use the MimicGen NIM microservice to generate synthetic datasets from the recordings.
\nThe developers train the Project GR00T humanoid foundation model with real and synthetic data, enabling developers to save time and reduce costs. They then use the Robocasa NIM microservice in Isaac Lab, a framework for robot learning, to generate experiences to retrain the robot model. Throughout the workflow, NVIDIA OSMO seamlessly assigns computing jobs to different resources, saving the developers weeks of administrative tasks.
\nFourier, a general-purpose robot platform company, sees the benefit of using simulation technology to synthetically generate training data.
\n\u201cDeveloping humanoid robots is extremely complex \u2014 requiring an incredible amount of real data, tediously captured from the real world,\u201d said Alex Gu, CEO of Fourier. \u201cNVIDIA\u2019s new simulation and generative AI developer tools will help bootstrap and accelerate our model development workflows.\u201d<\/p>\n

Expanding Access to NVIDIA Humanoid Developer Technologies<\/strong>
\nNVIDIA provides three computing platforms to ease humanoid robotics development: NVIDIA AI supercomputers to train the models; NVIDIA Isaac Sim built on Omniverse, where robots can learn and refine their skills in simulated worlds; and NVIDIA Jetson™ Thor humanoid robot computers to run the models. Developers can access and use all \u2014 or any part of \u2014 the platforms for their specific needs.
\nThrough a new NVIDIA Humanoid Robot Developer Program, developers can gain early access to the new offerings as well as the latest releases of NVIDIA Isaac Sim, NVIDIA Isaac Lab, Jetson Thor and Project GR00T general-purpose humanoid foundation models.
\n1x, Boston Dynamics, ByteDance Research, Field AI, Figure, Fourier, Galbot, LimX Dynamics, Mentee, Neura Robotics, RobotEra and Skild AI are among the first to join the early-access program.
\n\u201cBoston Dynamics and NVIDIA have a long history of close collaboration to push the boundaries of what\u2019s possible in robotics,\u201d said Aaron Saunders, chief technology officer of Boston Dynamics. \u201cWe\u2019re really excited to see the fruits of this work accelerating the industry at large, and the early-access program is a fantastic way to access best-in-class technology.\u201d<\/p>\n

Above, image credited to Nvidia<\/em><\/span><\/p>\n","protected":false},"excerpt":{"rendered":"

Developers gain access to new NVIDIA NIM microservices for robotics simulation in Isaac Lab and Isaac Sim, OSMO robot cloud compute orchestration service, teleoperated data capture workflow and more To accelerate humanoid development on a global scale, NVIDIA announced it is providing the world\u2019s leading robot manufacturers, AI model developers and software makers with a … <\/p>\n

Continue reading \u00abNVIDIA accelerates humanoid robotics development\u00bb<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":18388,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[50,61],"tags":[],"_links":{"self":[{"href":"https:\/\/telecomkh.info\/index.php?rest_route=\/wp\/v2\/posts\/18387"}],"collection":[{"href":"https:\/\/telecomkh.info\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/telecomkh.info\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/telecomkh.info\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/telecomkh.info\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=18387"}],"version-history":[{"count":1,"href":"https:\/\/telecomkh.info\/index.php?rest_route=\/wp\/v2\/posts\/18387\/revisions"}],"predecessor-version":[{"id":18389,"href":"https:\/\/telecomkh.info\/index.php?rest_route=\/wp\/v2\/posts\/18387\/revisions\/18389"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/telecomkh.info\/index.php?rest_route=\/wp\/v2\/media\/18388"}],"wp:attachment":[{"href":"https:\/\/telecomkh.info\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=18387"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/telecomkh.info\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=18387"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/telecomkh.info\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=18387"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}