GitHub - ggml-org/ggml: Tensor library for machine learning
4 days ago
- #tensor library
- #ggml
- #machine learning
- Tensor library for machine learning under active development.
- Development happening in llama.cpp and whisper.cpp repos.
- Features include low-level cross-platform implementation, integer quantization support, broad hardware support, automatic differentiation, ADAM and L-BFGS optimizers, no third-party dependencies, and zero memory allocations during runtime.
- Instructions for cloning the repository and setting up the environment.
- Steps to build examples and run the GPT-2 small 117M model.
- Commands for enabling CUDA, HIP, and SYCL support.
- Instructions for Android NDK setup and running the model on Android devices.