- Agent Draw is built on tldraw's infinite-canvas SDK for React, allowing an AI agent to draw on the canvas while a user presents.
- The tool works by capturing a rectangle on the canvas, recording speech via a browser mic, transcribing it to text using Mistral's Voxtral model, and queuing multiple drawings for sequential processing.
- Implementation involves a state machine-based canvas tool, an audio recorder, a transcription route in a Cloudflare Worker, and integration with tldraw's official Agent starter kit for the drawing logic.
- Using agent.prompt instead of agent.request ensures the AI completes entire drawings in one go without needing follow-up turns, and removing non-essential actions like setMyView and review reduces model calls.