Why Fei-Fei Li and Yann LeCun Are Both Betting on "World Models"
9 days ago
- #AI
- #Machine Learning
- #World Models
- Fei-Fei Li's World Labs launched Marble, a multimodal world model that generates editable 3D scenes from text, images, or videos.
- Yann LeCun is reportedly leaving Meta to start a company focused on world models, emphasizing internal predictive state for autonomous agents.
- DeepMind's Genie 3 is an interactive video engine described as a world model, generating real-time video environments for AI training.
- Marble uses Gaussian splatting to create 3D assets, while LeCun's approach focuses on latent state prediction for cognition.
- World models now encompass three distinct ideas: interface (Marble), simulator (Genie 3), and cognition (LeCun's JEPA).
- The term 'world model' is used differently across projects, leading to confusion about its meaning in AI development.