Microsoft Foundry Local for Windows and Mac
a year ago
- #AI
- #On-Device
- #Inference
- Foundry Local is in public preview, offering early access to features before General Availability (GA).
- It provides on-device AI inference, reducing costs and keeping data private by running models locally.
- Features include model customization, cost efficiency, and seamless integration via CLI, SDK, and REST API.
- Ideal for sensitive data, offline environments, cost reduction, low-latency needs, and pre-cloud experimentation.
- No Azure subscription is required; it runs on local hardware.
- Getting started involves following the 'Get started with Foundry Local' guide for setup and model deployment.