Ollama 0.12.11 Brings Vulkan Acceleration
8 days ago
- #AI
- #ollama
- #Vulkan
- ollama 0.12.11 introduces Vulkan API support as an alternative to AMD ROCm and NVIDIA CUDA acceleration.
- Vulkan support is beneficial for open-source drivers, older AMD GPUs without ROCm, and systems with RADV drivers.
- In some cases, Vulkan can outperform ROCm, as seen in Llama.cpp testing.
- The release also includes API support for Logprobs and WebP image support in the new app.
- Improved rendering performance and preference for discrete GPUs over integrated GPUs when scheduling models.
- Various other fixes and enhancements are part of this update.