microsoft / onnxruntime
git clone https://github.com/microsoft/onnxruntime.git
v1.31.0 · 13d ago
ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator
+5
stars, 24h · #2,998
+~35
stars, 7 days · #3,626
+~150
stars, 30 days · #3,622
22k
★ total · +0% this week
4.3k
forks · 1.8k open issues
Star history (as recorded here)
LanguageC++
LicenseMIT
Created2018-11-10 (7y ago)
Last pushtoday
Watchers265
OwnerOrganization
GitHub topics
ai-frameworkdeep-learninghardware-accelerationmachine-learningneural-networksonnxpytorchscikit-learntensorflow
Links
- GitHub: github.com/microsoft/onnxruntime
- Homepage: https://onnxruntime.ai
- Releases · Issues · Hacker News mentions
README excerpt
**ONNX Runtime is a cross-platform inference and training machine-learning accelerator**. **ONNX Runtime inference** can enable faster customer experiences and lower costs, supporting models from deep learning frameworks such as PyTorch and TensorFlow/Keras as well as classical machine learning libraries such as scikit-learn, LightGBM, XGBoost, etc. ONNX Runtime is compatible with different hardware, drivers, and operating systems, and provides optimal performance by leveraging hardware accelerators where applicable alongside graph optimizations and transforms. Learn more → **ONNX Runtime training** can accelerate the model training time on multi-node NVIDIA GPUs for transformer models with a one-line addition for existing PyTorch training scripts. Learn more → ## Get Started & Resources * **General Information**: onnxruntime.ai * **Usage documentation and tutorials**: onnxruntime.ai/docs * **YouTube video tutorials**: youtube.com/@ONNXRuntime * **Upcoming Release Roadmap** * **Companion sample repositories**: - ONNX Runtime Inferencing: microsoft/onnxruntime-inference-examples - ONNX Runtime Training: microsoft/onnxruntime-training-examples * **Plugin EP repositories**: - ONNX Runtime QNN Plugin EP: onnxruntime/onnxruntime-qnn ## Releases The current release and past releases can be found here: https://github.com/microsoft/onnxruntime/releases. For details on the upcoming release, including release dates, announcements, features, and guidance on submitting feature requests, please visit the release roadmap: https://onnxruntime.ai/roadmap. ## Data/Telemetry This project may collect usage data and send it to Microsoft to help improve our products and services. See the privacy statement for more details. ## Contributions and Feedback We welcome contributions! Please see the contribution guidelines. For feature requests or bug reports, please file a GitHub Issue. For general discussion or questions, please use GitHub Discussions. ## Code of Conduct This project has adopted the Microsoft Open Source Code of Conduct. For more information see the Code of Conduct FAQ or contact opencode@microsoft.com with any additional questions or comments. ## License This project is licensed under the MIT License.