vllm-project / aibrix
git clone https://github.com/vllm-project/aibrix.git
Cost-efficient and pluggable Infrastructure components for GenAI inference
+0
stars, 24h · #58,714
+~0
stars, 7 days · #58,788
+~0
stars, 30 days · #58,926
5.2k
★ total
747
forks · 371 open issues
Star history (as recorded here)
LanguageGo
LicenseApache-2.0
Created2024-06-10 (2y ago)
Last pushtoday
OwnerOrganization