Voice Controlled Swarms
20 days ago
- #swarm-simulation
- #voice-control
- #LLM-agents
- Voice-controlled swarms inspired by Command School from Ender's Game.
- Architecture involves voice-to-text feeding commands into an LLM connected to an MCP server.
- Voice-controller is application-agnostic, reusable across MCP-compatible applications.
- Canvas MCP Server example with tools like create_circle, create_square, move_shapes, etc.
- LLM can creatively solve problems, like moving shapes off-screen when removal isn't possible.
- Swarm simulation uses a modified boids algorithm with separation and alignment rules.
- Tools for swarm control include assign_swarm_to_position, fork_swarm_to_position, reassign_drones, etc.
- Assignment Problem used for position-aware drone reassignment, optimizing for visual appeal.
- Additional features: no-fly zones, circling, landmarks, phonetic IDs, and coordinate grids.
- All code available on GitHub.