Show HN: Controlling 3D models with voice and hand gestures
a year ago
- #3D-modeling
- #Web-development
- #Computer-vision
- Control 3D models using hand gestures and voice commands in real-time.
- Interactive web app built with Three.js, MediaPipe, Web Speech API, and Rosebud AI.
- Voice commands: 'drag', 'rotate', 'scale', or 'animate' to change interaction mode.
- Pinch fingers to control the 3D model.
- Drag/drop GLTF format 3D models to import them.
- Requires modern browser with WebGL, camera, and microphone access.
- Technologies used: Three.js, MediaPipe, Web Speech API, HTML5 Canvas, JavaScript.
- MIT License.
- Other projects include hand tracking tutorials, particle animations, and ASCII video conversion.
- Contact and support details provided.