Provides a PyTorch backend that runs PyTorch models and operations on Google's Tensor Processing Units (TPUs).
An all-in-one, pure C++ inference engine for audio models, powered by ggml. Supports TTS, STT, VAD, voice conversion, music generation, and more, with highly optimized performance. No Python dependency.
An Open Source Machine Learning Framework for Everyone
ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator
OpenVINO™ is an open source toolkit for optimizing and deploying AI inference