bentoml / BentoML
git clone https://github.com/bentoml/BentoML.git
The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
+2
stars, 24h · #7,216
+~14
stars, 7 days · #7,891
+~60
stars, 30 days · #9,672
8.9k
★ total · +0% this week
1.0k
forks · 239 open issues
Star history (as recorded here)
LanguagePython
LicenseApache-2.0
Created2019-04-02 (7y ago)
Last push3d ago
OwnerOrganization
GitHub topics
ai-inferencedeep-learninggenerative-aiinference-platformllmllm-inferencellm-servingllmopsmachine-learningml-engineeringmlopsmodel-inference-servicemodel-servingmultimodalpython
Links
- GitHub: github.com/bentoml/BentoML
- Homepage: https://bentoml.com
- Releases · Issues · Hacker News mentions