Mozilla Releases Llamafile 0.10
8 hours ago
- #AI
- #LLM
- #Mozilla
- Mozilla releases Llamafile 0.10, enhancing their AI offering for easy-to-use LLMs.
- Llamafile allows running large language models as a single file across platforms and hardware.
- New features in Llamafile 0.10 include a new build system, support for new modes, and updated Llama.cpp.
- Integration of Whisper.cpp and Stable Diffusion as sub-modules, improved BSD support, and other changes.
- New hybrid text user interface chat/server mode, CLI modality for one-shot questions, improved logging, and argument handling.
- Added '--image' argument for specifying images, Metal GPU support on macOS, and restored NVIDIA CUDA support.
- Documentation and downloads available on GitHub.