Agent-o-rama: build, trace, evaluate, and monitor LLM agents in Java or Clojure
6 months ago
- #JVM
- #LLM
- #AgentFramework
- Agent-o-rama is an open-source library for building scalable and stateful LLM agents on the JVM.
- It provides APIs for both Java and Clojure with feature parity.
- Addresses the lack of integrated tooling in the JVM ecosystem for LLM-based systems.
- Includes features like structured agent graphs, tracing, datasets, experiments, and evaluation.
- Agents are defined as graphs of Java or Clojure functions that execute in parallel.
- Comes with a web UI for offline experimentation, online evaluation, and telemetry.
- Supports streaming with a simple client API for real-time model calls.
- Deployed on Rama clusters, scalable from two nodes to thousands with a commercial license.
- Example provided for a research agent, including setup and execution instructions.
- Includes detailed traces and statistics for agent execution in the UI.
- Documentation and resources available for quickstart, full docs, and community support.