GitHub - google-ai-edge/LiteRT-LM
6 days ago
- #edge-ai
- #open-source
- #llm-deployment
- LiteRT-LM is Google's open-source inference framework for deploying LLMs on edge devices.
- Supports deployment across various platforms like Android, iOS, Web, Desktop, and IoT.
- Features hardware acceleration via GPU/NPU, multi-modality, tool use, and broad model support.
- Enables on-device GenAI experiences in Chrome, Chromebook Plus, and Pixel Watch.
- Offers CLI tools and language-specific guides (Kotlin, Python, C++, Swift) for development.