Lightning-AI / LitServe
git clone https://github.com/Lightning-AI/LitServe.git
A minimal Python framework for building custom AI inference servers with full control over logic, batching, and scaling.
—
stars, 24h
—
stars, 7 days
—
stars, 30 days
4.0k
★ total
313
forks · 66 open issues
Star history starts 2026-10-20; the chart appears after the second daily snapshot.
LanguagePython
LicenseApache-2.0
Created2023-12-12 (2y ago)
Last pushtoday
OwnerOrganization