kubeai-project / kubeai
git clone https://github.com/kubeai-project/kubeai.git
AI Inference Operator for Kubernetes. The easiest way to serve ML models in production. Supports VLMs, LLMs, embeddings, and speech-to-text.
+-1
stars, 24h · #62,229
+~-2
stars, 7 days · #60,861
+~-8
stars, 30 days · #61,275
1.3k
★ total · -0% this week
141
forks · 105 open issues
Star history (as recorded here)
LanguageGo
LicenseApache-2.0
Created2023-10-21 (3y ago)
Last push1d ago
OwnerOrganization
GitHub topics
aiautoscalerfaster-whisperinference-operatork8skubernetesllmollamaollama-operatoropenai-apivllmvllm-operatorwhisper
Links
- GitHub: github.com/kubeai-project/kubeai
- Homepage: https://www.kubeai.org
- Releases · Issues · Hacker News mentions
README
Loading README…