Researchers create 3D interactive digital room from simple video
10 months ago
- #AI
- #Robotics
- #3D Modeling
- Cornell researchers developed an AI-powered process to create interactive 3D digital twins from simple videos.
- The technology, called DRAWER, allows users to interact with objects in the digital space, useful for video games and robot training.
- DRAWER combines multiple AI models to render photorealistic and interactive scenes from casual videos, like those taken with an iPhone.
- The framework integrates methods for rendering attractive images, accurate dimensions, and determining movable parts of the scene.
- Researchers demonstrated DRAWER's potential by creating a game and training a robotic arm in a digital twin of a kitchen.
- Future goals include expanding DRAWER to handle soft objects, entire buildings, and outdoor spaces for city design and agriculture.
- The project received support from various tech companies and government agencies, including Intel, Meta, and DARPA.