Show HN: Local Browser AI
9 hours ago
- #Browser Extensions
- #Prompt API
- #Edge AI
- Prompt API enables running small language models (SLMs) directly in the browser with a simple JavaScript API.
- Local Browser AI is a browser extension demonstrating Prompt API's capabilities, offering privacy, no tracking, and minimal permissions.
- Edge AI (running SLMs locally) provides benefits like lower cost, higher privacy, speed, and flexibility compared to Cloud AI.
- Challenges of Edge AI include higher initial hardware costs, model download size, and limited model capabilities compared to LLMs.
- Prompt API simplifies Edge AI by handling model downloads, caching, and execution, reducing the need for external libraries.
- The API is stateful, supports multi-modal inputs (text, images, audio), and is currently available only in Chrome and Edge extensions.
- Session management in Prompt API is immutable, requiring cloning for new chats or parameter changes.
- The extension is open-source (MIT license), works across major OSes, and demonstrates a simple chat interface using native browser APIs.