Lyra 2.0: Explorable Generative 3D Worlds
7 hours ago
- #video-to-3D
- #AI simulation
- #3D scene generation
- Lyra 2.0 generates camera-controlled walkthrough videos and lifts them to 3D via feed-forward reconstruction for 3D scene creation.
- It addresses spatial forgetting by using per-frame 3D geometry for information routing and temporal drifting via self-augmented training to correct errors.
- The framework enables persistent, explorable 3D worlds with long-horizon, 3D-consistent video generation, overcoming degradation in existing methods.
- An interactive GUI allows visualization of accumulated point clouds and user-guided camera trajectories for scene exploration.
- Generated outputs can be exported as 3D Gaussians or meshes for real-time rendering and simulation in physics engines like NVIDIA Isaac Sim.