mosecorg / mosec
git clone https://github.com/mosecorg/mosec.git
A high-performance ML model serving framework, offers dynamic batching and CPU/GPU pipelines to fully exploit your compute machine
—
stars, 24h
—
stars, 7 days
—
stars, 30 days
902
★ total
75
forks · 14 open issues
Star history starts 2026-10-20; the chart appears after the second daily snapshot.
LanguagePython
LicenseApache-2.0
Created2021-03-13 (5y ago)
Last push8d ago
OwnerOrganization
GitHub topics
cvdeep-learninggpuhacktoberfestjaxllmllm-servingmachine-learningmachine-learning-platformmlopsmodel-servingmxnetnerual-networkpythonpytorchrusttensorflowtts
Links
- GitHub: github.com/mosecorg/mosec
- Homepage: https://mosecorg.github.io/mosec/
- Releases · Issues · Hacker News mentions