
What the hardware does
A webcam tracks the user's hand to move a puppet, while a microphone supplies speech for an AI-controlled character on a browser-rendered stage.
How the agent helped
Anthropic's winner interview credits Rene Hangstrup Møller with using Claude across concept discussion, planning and code writing. The creator's repository documents MediaPipe hand tracking, Three.js rendering and the required camera and microphone.
Before you build
Requires a webcam, microphone and a capable computer running a supported desktop browser. The repository recommends Chrome or Edge, HTTPS or localhost, and a required Anthropic API key; ElevenLabs speech is optional. Model services can incur charges. Grant camera and microphone access deliberately. The image is a frame from the creator's software demo, not a photograph of a special-purpose hardware product. No specific webcam model is required or verified.
Follow the build
Original build story
Creator interview and repository



