Simulation for
Self-Driving Cars

Accelerate autonomous vehicle development in the virtual world.

NVIDIA DRIVE Sim, Powered by Omniverse

Autonomous vehicles require large-scale development and testing in a wide range of scenarios before they can be deployed. However, driving the necessary number of miles in the real world is time- and capital-intensive. Moreover, it is practically impossible to encounter the rare and dangerous scenarios needed for comprehensive autonomous vehicle validation. NVIDIA DRIVE Sim addresses these challenges with a scalable, physically accurate, and diverse simulation platform. With DRIVE Sim, AV developers can improve productivity, efficiency, and test coverage, advancing time-to-market while minimizing real-world driving.

DRIVE Sim: Virtual Vehicles, Real-World Results

DRIVE Sim uses high-fidelity and physically accurate simulation to create a safe, scalable, and cost-effective way to bring self-driving vehicles to our roads. It taps into NVIDIA’s core technologies—including NVIDIA RTX, Omniverse, and AI—to deliver a powerful, cloud-based computing platform capable of generating a wide range of real-world scenarios for AV development and validation. DRIVE Sim can generate datasets to train the vehicle’s perception systems or test the decision-making processes. It can also be connected to the AV stack in software-in-the-loop (SIL) or hardware-in-the-loop (HIL) configurations to validate the complete integrated system.

Expanding Capabilities with Omniverse

DRIVE Sim is built on NVIDIA Omniverse, which provides the core simulation and rendering engines. Autonomous vehicle simulation has extremely tight timing, repeatability, and real-time performance requirements, and must be able to operate at scale. Additionally, generating data from AV sensor sets in physically based virtual worlds requires tremendous compute loads. NVIDIA Omniverse is architected from the ground up with multi-GPU support for large-scale, multi-sensor simulation for autonomous vehicles. It also enables physically accurate, real-time sensor simulation with NVIDIA RTX.

Synthetic Data Generation for Training Autonomous Vehicles

NVIDIA Omniverse Replicator powers DRIVE Sim, generating physically based sensor data for camera, radar, lidar, and ultrasonics along with the corresponding ground-truth. This data is then used for training AI perception networks for AVs. Using synthetic data reduces time and cost, is always accurate, and produces ground truth that humans can’t label, such as depth, velocity and occluded objects. It also generates training data for rare and dangerous scenes to augment real data for a targeted approach to solving some of AVs’ biggest challenges.

DRIVE Constellation

DRIVE Sim can run on a local workstation or scale to multiple GPUs across nodes. It also supports software-in-the-loop (SIL) and hardware-in-the-loop (HIL) configurations.

NVIDIA DRIVE Constellation provides a dedicated hardware platform for HIL powered by two servers. The first is a GPU server to run DRIVE Sim and generate synthetic sensor data from the simulated environment. The second is a vehicle server that contains the target vehicle computer that receives and responds as if it were operating in the real world. DRIVE Constellation is designed to run at scale in a data center, accelerating autonomous vehicle development and validation by testing the self-driving software on its target hardware with bit- and timing-accuracy. It’s fully compatible with the NVIDIA DRIVE AGX platform or can be customized with third-party hardware.

Open and Extensible

DRIVE Sim is open, modular, and extensible, using the Omniverse KIT SDK to allow developers to build compatible models, 3D content, and validation tools. Users can create their own extensions or choose from a rich library of vehicle, sensor, and traffic plug-ins provided by DRIVE Sim ecosystem partners. This flexibility lets users customize DRIVE Sim for their unique use case and tailor the simulation experience to their development and validation needs.

Meet a Few of Our Sim Ecosystem Partners

MathWorks logo

Rapidly import environments into DRIVE Sim with MathWorks RoadRunner

dSpace logo

Simulate the entire vehicle with dSPACE HIL and DRIVE Sim

Luminar logo

Achieve detailed lidar simulation with Luminar’s sensor models in DRIVE Sim

Hum3D logo

Bring assets directly into DRIVE Sim from Hum3D marketplace

carsim logo

Plug your CarSim models into DRIVE Sim for realistic vehicle dynamics

AVL logo

Quickly expand DRIVE Sim’s V&V capabilities by connecting to AVL’s Model. CONNECT platform

NVIDIA automotive solutions are available to automakers, tier 1 suppliers, startups, and research institutions shaping the future of transportation.