AMD Ryzen AI NPUs Are Finally Useful Under Linux for Running LLMs
4 hours ago
- #Linux
- #LLM
- #AMD Ryzen AI
- AMD Ryzen AI NPUs now support LLMs on Linux via Lemonade 10.0 and FastFlowLM.
- FastFlowLM 0.9.35 enables Ryzen AI NPUs to handle context lengths up to 256k tokens.
- Linux kernel 7.0 or AMDXDNA driver back-ports are required for Ryzen AI NPU support.
- Support extends to AMD Ryzen AI 300/400 series SoCs.
- Lemonade 10.0 also integrates Whisper and Claude Code.
- The development is timely with Ryzen AI Embedded P100 and PRO 400 series entering the market.