Real-time Hand Gesture & Voice Control for 3D Models

2025-06-03
Real-time Hand Gesture & Voice Control for 3D Models

Control 3D models in real-time using only your hands and voice! This interactive web app leverages three.js, MediaPipe computer vision, the Web Speech API, and Rosebud AI. You can drag, rotate, scale, and animate models, and import your own GLTF models by drag-and-drop. All you need is a modern WebGL-enabled browser, camera and microphone access. Clone the repo and experience the magic!

Development