- To build digital twins of 64 World Cup games using 3D reconstruction from player tracking data.
- Sports data is collected via computer vision on live broadcasts, including object detection, field geometry, and event tagging.
- PFF provides the most complete public data for 2022 World Cup with 30Hz XY tracking, allowing high-fidelity 3D visualization.
- A 'video player' architecture includes an API server, streaming endpoint, and web viewer for 2D/3D game rendering.
- Player motions and cutscenes (e.g., headers, corner kicks) are triggered by event data to handle frames without tracking data.
- The reconstruction can be customized (e.g., simulating alien players on Mars) and is open-sourced for further development.