Show HN: I built an AI agent that turns ROS 2's turtlesim into a digital artist
a year ago
- #AI
- #LangChain
- #ROS
- turtlesim_agent is an AI agent that transforms the ROS turtlesim simulator into a creative canvas using natural language.
- Powered by LangChain, it interprets text instructions to create visual drawings with the turtle.
- Users can describe shapes in plain English, and the AI executes them using turtlesim's motion commands.
- Example: Drawing a rainbow with 7 semi-circular arcs of different colors and specified radii.
- Compatibility: ROS 2 Humble Hawksbill, Python 3.10+, and dependencies listed in requirements.txt.
- Setup involves cloning the repository, installing dependencies, and building the workspace.
- Supports multiple language model providers via LangChain (OpenAI, Anthropic, Google, Cohere, Mistral).
- Environment variables need to be set for API keys and optional LangSmith tracing.
- Configuration requires updating the model name in turtlesim_node.py and turtlesim_agent.launch.xml.
- Offers CLI and GUI interaction modes for user-friendly operation.
- Tools directory contains callable functions for drawing tasks, with options to add custom tools.
- Encourages community contributions for new tools, models, prompts, and use cases.