The Waymo World Model: A New Frontier for Autonomous Driving Simulation
6 hours ago
- #Autonomous Driving
- #Simulation Technology
- #AI Safety
- Waymo has introduced the Waymo World Model, a generative model for hyper-realistic autonomous driving simulation.
- The model is built on Google DeepMind's Genie 3, enabling simulation of rare events like tornadoes or encounters with elephants.
- It offers high controllability through language prompts, driving inputs, and scene layouts, generating multi-sensor outputs including camera and lidar data.
- The model leverages vast world knowledge from 2D videos, converting them into 3D lidar outputs for diverse scenarios.
- Simulation controllability includes driving action control, scene layout control, and language control for custom scenarios.
- The model can convert dashcam videos into multimodal simulations, enhancing realism.
- A more efficient variant allows for longer scene simulations with reduced compute requirements.
- The Waymo World Model aims to prepare autonomous vehicles for rare and complex scenarios, improving safety benchmarks.