GitHub - microsoft/onnxruntime: ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator
2 hours ago
- #cross-platform
- #machine learning
- #inference accelerator
- ONNX Runtime is a cross-platform accelerator for machine learning inference and training.
- It supports models from various frameworks like PyTorch, TensorFlow/Keras, and libraries such as scikit-learn, LightGBM, and XGBoost.
- It offers faster performance and lower costs by leveraging hardware accelerators, graph optimizations, and transforms, and is compatible with multiple hardware and operating systems.
- Training acceleration is available for transformer models on multi-node NVIDIA GPUs with minimal code changes in existing PyTorch scripts.
- Resources include documentation, tutorials, sample repositories, release details on GitHub, and a roadmap for upcoming features.
- The project collects usage data on Windows for product improvement, welcomes contributions, and is licensed under the MIT License with a code of conduct.