Sam 3D: Powerful 3D Reconstruction for Physical World Images
3 days ago
- #Meta
- #AI
- #3D Modeling
- Introduction of SAM 3D, a first-of-its-kind model for 3D understanding of natural images.
- Two new models: SAM 3D Objects for object/scene reconstruction and SAM 3D Body for human body/shape estimation.
- Release includes model checkpoints, inference code, and upcoming SA-3DAO dataset for 3D reconstruction.
- Segment Anything Playground introduced for easy experimentation with SAM 3D models.
- SAM 3D used in Meta products like Facebook Marketplace's View in Room feature.
- SAM 3D Objects overcomes data limitations with a new annotation engine and training recipe.
- SAM 3D Artist Objects (SA-3DAO) dataset provides a challenging benchmark for 3D reconstruction.
- SAM 3D Body offers accurate 3D human pose/shape estimation, supporting interactive inputs.
- Both models have limitations, such as output resolution and multi-object reasoning.
- Encouragement for creators, developers, and researchers to explore SAM 3D's potential.