{"id":4395,"date":"2025-12-17T17:39:58","date_gmt":"2025-12-17T17:39:58","guid":{"rendered":"https:\/\/salarydistribution.com\/machine-learning\/2025\/12\/17\/into-the-omniverse-openusd-and-nvidia-halos-accelerate-safety-for-robotaxis-physical-ai-systems\/"},"modified":"2025-12-17T17:39:58","modified_gmt":"2025-12-17T17:39:58","slug":"into-the-omniverse-openusd-and-nvidia-halos-accelerate-safety-for-robotaxis-physical-ai-systems","status":"publish","type":"post","link":"https:\/\/salarydistribution.com\/machine-learning\/2025\/12\/17\/into-the-omniverse-openusd-and-nvidia-halos-accelerate-safety-for-robotaxis-physical-ai-systems\/","title":{"rendered":"Into the Omniverse: OpenUSD and NVIDIA Halos Accelerate Safety for Robotaxis, Physical AI Systems"},"content":{"rendered":"
\n\t\t<\/span> <\/span> <\/span><\/span><\/p>\n

Editor\u2019s note: This post is part of <\/i>Into the Omniverse<\/i><\/a>, a series focused on how developers, 3D practitioners and enterprises can transform their workflows using the latest advancements in <\/i>OpenUSD<\/i><\/a> and <\/i>NVIDIA Omniverse<\/i><\/a>.<\/i><\/p>\n

Physical AI<\/a> is moving from research labs into the real world, powering intelligent robots and autonomous vehicles (AVs)<\/a> \u2014 such as robotaxis \u2014 that must reliably sense, reason and act amid unpredictable conditions.<\/p>\n

To safely scale these systems, developers need workflows that connect real-world data, high-fidelity simulation and robust AI models atop the common foundation provided by the OpenUSD<\/a> framework.<\/p>\n

The recently published OpenUSD Core Specification 1.0<\/a>, OpenUSD \u2014 aka Universal Scene Description \u2014 now defines standard data types, file formats and composition behaviors, giving developers predictable, interoperable USD pipelines as they scale autonomous systems.<\/p>\n

Powered by OpenUSD, NVIDIA Omniverse libraries<\/a> combine NVIDIA RTX<\/a> rendering, physics simulation and efficient runtimes to create digital twins and simulation-ready (SimReady<\/a>) assets that accurately reflect real-world environments for synthetic data generation and testing.<\/p>\n

NVIDIA Cosmos<\/a> world foundation models can run on top of these simulations to amplify data variation, generating new weather, lighting and terrain conditions from the same scenes so teams can safely cover rare and challenging edge cases.<\/p>\n

Learn more by watching the OpenUSD livestream today at 11 a.m. PT or in replay, part of the NVIDIA Omniverse OpenUSD Insiders series:<\/i><\/p>\n<\/p>\n

In addition, advancements in synthetic data generation<\/a>, multimodal datasets and SimReady workflows are now converging with the NVIDIA Halos<\/a> framework for AV safety, creating a standards-based path to safer, faster, more cost-effective deployment of next-generation autonomous machines.<\/p>\n

Building the Foundation for Safe Physical AI<\/b><\/h2>\n

Open Standards and SimReady Assets<\/b><\/p>\n

The OpenUSD Core Specification 1.0<\/a> establishes the standard data models and behaviors that underpin SimReady assets, enabling developers to build interoperable simulation pipelines for AI factories and robotics on OpenUSD<\/a>.<\/p>\n

Built on this foundation, SimReady 3D assets can be reused across tools and teams and loaded directly into NVIDIA Isaac Sim<\/a>, where USDPhysics colliders, rigid body dynamics and composition-arc\u2013based variants let teams test robots in virtual facilities that closely mirror real operations.<\/p>\n

Open-Source Learning\u00a0<\/b><\/p>\n

The Learn OpenUSD<\/a> curriculum is now open source and available on GitHub, enabling contributors to localize and adapt templates, exercises and content for different audiences, languages and use cases. This gives educators a ready-made foundation to onboard new teams into OpenUSD-centric simulation workflows.\u200b<\/p>\n

Generative Worlds as Safety Multiplier<\/b><\/p>\n

Gaussian splatting \u2014 a technique that uses editable 3D elements to render environments quickly and with high fidelity \u2014 and world models are accelerating simulation pipelines for safe robotics testing and validation.<\/p>\n

At SIGGRAPH Asia, the NVIDIA Research<\/a> team introduced Play4D<\/a>, a streaming pipeline that enables 4D Gaussian splatting to accurately render dynamic scenes and improve realism.<\/p>\n

Spatial intelligence company World Labs<\/a> is using its Marble generative world model with NVIDIA Isaac Sim<\/a> and Omniverse NuRec<\/a> so researchers can turn text prompts and sample images into photorealistic, Gaussian-based physics-ready 3D environments in hours instead of weeks.<\/p>\n

\"\"<\/p>\n

Those worlds can then be used for physical AI training, testing and sim-to-real transfer. This high-fidelity simulation workflow expands the range of scenarios robots can practice in while keeping experimentation safely in simulation.<\/p>\n

Lightwheel Helps Teams Scale Robot Training With SimReady Assets<\/b><\/p>\n

Powered by OpenUSD, Lightwheel<\/a>\u2019s SimReady asset library includes a common scene description layer, making it easy to assemble high-fidelity digital twins for robots. The SimReady assets are embedded with precise geometry, materials and validated physical properties, which can be loaded directly into NVIDIA Isaac Sim and Isaac Lab for robot training. This allows robots to experience realistic contacts, dynamics and sensor feedback as they learn.<\/p>\n

End-to-End Autonomous Vehicle Safety<\/b><\/h2>\n

End-to-end autonomous vehicle safety advancements are accelerating with new research, open frameworks and inspection services that make validation more rigorous and scalable.<\/p>\n

NVIDIA researchers, with collaborators at Harvard University and Stanford University, recently introduced the Sim2Val framework<\/a> to statistically combine real-world and simulated test results, reducing AV developers\u2019 need for costly physical mileage while demonstrating how robotaxis and AVs can behave safely across rare and safety-critical scenarios.<\/p>\n

Learn more by watching NVIDIA\u2019s \u201cSafety in the Loop\u201d livestream:<\/p>\n<\/p>\n

These innovations are complemented by a new, open-source NVIDIA Omniverse NuRec Fixer, a Cosmos-based model trained on AV data that removes artifacts in neural reconstructions to produce higher-quality SimReady assets.<\/p>\n

To align these advances with rigorous global standards, the NVIDIA Halos AI Systems Inspection Lab<\/a> \u2014 accredited by ANAB \u2014 provides impartial inspection and certification of Halos elements across robotaxi fleets, AV stacks, sensors and manufacturer platforms through the Halos Certification Program<\/a>.<\/p>\n

AV Ecosystem Leaders Putting Physical AI Safety to Work<\/strong><\/p>\n

Bosch<\/a>, Nuro<\/a> and Wayve<\/a> are among the first participants in the NVIDIA Halos AI Systems Inspection Lab, which aims to accelerate the safe, large-scale deployment of robotaxi fleets. Onsemi, which makes sensor systems for AVs, industrial automation and medical applications, has recently become the first company to pass inspection for the NVIDIA Halos AI Systems Inspection Lab.<\/p>\n<\/p>\n

The open-source CARLA<\/a> simulator integrates NVIDIA NuRec and Cosmos Transfer<\/a> to generate reconstructed drives and diverse scenario variations, while Voxel51<\/a>\u2019s FiftyOne engine, linked to Cosmos Dataset Search, NuRec and Cosmos Transfer, helps teams curate, annotate and evaluate multimodal datasets across the AV pipeline.\u200b<\/p>\n<\/p>\n

Mcity at the University of Michigan is enhancing the digital twin of its 32-acre AV test facility<\/a> using Omniverse libraries and technologies. The team is integrating the NVIDIA Blueprint for AV simulation and Omniverse Sensor RTX application programming interfaces to create physics-based models of camera, lidar, radar and ultrasonic sensors.<\/p>\n

By aligning real sensor recordings with high-fidelity simulated data and sharing assets openly, Mcity enables safe, repeatable testing of rare and hazardous driving scenarios before vehicles operate on public roads.<\/p>\n

Get Plugged Into the World of OpenUSD and Physical AI Safety<\/b><\/h2>\n

Learn more about OpenUSD, NVIDIA Halos and physical AI safety by exploring these resources:<\/p>\n

Stay up to date by subscribing to<\/i> NVIDIA news<\/i><\/a>, joining the <\/i>community<\/i><\/a> and following NVIDIA Omniverse on <\/i>Instagram<\/i><\/a>, <\/i>LinkedIn<\/i><\/a>, <\/i>Medium<\/i><\/a> and <\/i>X<\/i><\/a>.<\/i><\/p>\n<\/p><\/div>\n","protected":false},"excerpt":{"rendered":"

https:\/\/blogs.nvidia.com\/blog\/openusd-halos-safety-robotaxi-physical-ai\/<\/p>\n","protected":false},"author":0,"featured_media":4396,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[3],"tags":[],"_links":{"self":[{"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/posts\/4395"}],"collection":[{"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/types\/post"}],"replies":[{"embeddable":true,"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/comments?post=4395"}],"version-history":[{"count":0,"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/posts\/4395\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/media\/4396"}],"wp:attachment":[{"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/media?parent=4395"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/categories?post=4395"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/tags?post=4395"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}