google-ai-edge / LiteRT-LM
git clone https://github.com/google-ai-edge/LiteRT-LM.git
LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.
+8
stars, 24h · #4,230
+~42
stars, 7 days · #4,718
+~180
stars, 30 days · #4,358
6.7k
★ total · +1% this week
765
forks · 710 open issues
Star history (as recorded here)
LanguageC++
LicenseApache-2.0
Created2025-04-14 (1y ago)
Last pushtoday
OwnerOrganization