Show HN: Any-LLM – lightweight and open-source router to access any LLM Provider
9 months ago
- #Python
- #LLM
- #API
- Simple, unified interface with one function for all providers and easy model switching.
- Developer-friendly with full type hints, clear error messages, and leveraging official provider SDKs.
- Framework-agnostic design for use across various projects and use cases.
- Actively maintained, used in any-agent product ensuring continued support.
- No need for Proxy or Gateway servers, simplifying setup.
- Addresses fragmented LLM provider ecosystem with consistent interface despite variations.
- Critiques existing solutions like LiteLLM, AISuite, and framework-specific integrations for their limitations.
- Requires Python 3.11 or newer and API keys for LLM access.
- Installation includes supported providers or 'all' option for comprehensive support.
- Example usage provided for basic completion with Mistral API.