NVIDIA Expands Omniverse with Generative Physical AI

Author photo: Chantal Polsonetti
ByChantal Polsonetti
Category:
Company and Product News

Accelerated computing provider NVIDIA announced generative AI models and blueprints that expand NVIDIA Omniverse integration further into physical AI applications such as robotics, autonomous vehicles, and vision AI.

New Models and Frameworks Accelerate World Building for Physical AI

Creating 3D worlds for physical AI simulation requires three steps: world building, labeling the world with physical attributes, and making it photoreal. NVIDIA offers generative AI models that accelerate each step. The USD Code and USD Search NVIDIA NIM microservices are now generally available, letting developers use text prompts to generate or search for OpenUSD assets. A new NVIDIA Edify SimReady generative AI model can automatically label existing 3D assets with attributes like physics or materials, enabling developers to process 1,000 3D objects in minutes instead of over 40 hours manually.

NVIDIA Omniverse, paired with new NVIDIA Cosmos world foundation models, creates a synthetic data multiplication engine—letting developers easily generate massive amounts of controllable, photoreal synthetic data. Developers can compose 3D scenarios in Omniverse and render images or videos as outputs. These can then be used with text prompts to condition Cosmos models to generate countless synthetic virtual environments for physical AI training.

NVIDIA Omniverse Blueprints Speed Up Industrial, Robotic Workflows

NVIDIA announced four new blueprints that make it easier for developers to build Universal Scene Description (OpenUSD)-based Omniverse digital twins for physical AI. The blueprints include:

  • Mega, powered by Omniverse Sensor RTX APIs, for developing and testing robot fleets at scale in an industrial factory or warehouse digital twin before deployment in real-world facilities.

  • Autonomous Vehicle (AV) Simulation, also powered by Omniverse Sensor RTX APIs, which lets AV developers replay driving data, generate new ground-truth data, and perform closed-loop testing to accelerate their development pipelines.

  • Omniverse Spatial Streaming to Apple Vision Pro helps developers create applications for immersive streaming of large-scale industrial digital twins to Apple Vision Pro.

  • Real-time Digital Twins for Computer Aided Engineering (CAE), a reference workflow built on NVIDIA CUDA-X acceleration, physics AI, and Omniverse libraries that enable real-time physics visualization.

Concurrently with the announcement, industrial automation leader Siemens announced the availability of Teamcenter Digital Reality Viewer—the first Siemens Xcelerator application powered by NVIDIA Omniverse libraries. Accenture (next-generation autonomous warehouses and robotic fleets), Altair (real-time CAE digital twins for interactive computational fluid dynamics - CFD), Ansys, Cadence (data center digital twin platform, semiconductor CAD), Foretellix, Microsoft, and Neural Concept (real-time CFD) are also among the first to integrate Omniverse into their next-generation software products and professional services.

Innoactive, an XR streaming platform for enterprises, used the workflow to add platform support for spatial streaming to Apple Vision Pro. The solution enables the Volkswagen Group to conduct design and engineering project reviews at human-eye resolution. Innoactive also collaborated with Syntegon, a provider of processing and packaging technology solutions for pharmaceutical production, to enable Syntegon’s customers to walk through and review digital twins of custom installations before they are built.

Find out more about Industrial AI's Role in Digital Transformation of Manufacturing Industries.

Engage with ARC Advisory Group

Representative End User Clients
Representative Automation Clients
Representative Software Clients