Conjuring portals with real-time video and Gaussian Splats
10 days ago
- #portal demo
- #3D Gaussian splat
- #real-time diffusion
- Latest model drops and powerful integrations are showcased.
- Demo uses real-time diffusion to generate a starting image explored as a 3D Gaussian splat.
- Real-time video generation model (LongLive + RIFE) animates starting images to preview portal contents.
- Portals can be conjured anywhere, allowing users to peer into another world via a generated video stream.
- Users can step through a portal into an explorable 3D Gaussian splat world created with Apple's ml-sharp.
- Images act as portals, offering a window into another world before stepping into it.
- Code for the demo is available on GitHub at https://github.com/yondonfu/scope-portal-demo.