📈 GH Trending Explorer 🎲 Surprise me

Search: on-device-llm · clear

google-ai-edge / LiteRT-LM

LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.

▲ ~21/7d ★ 6.7k C++ today
yanun0323 / Whallm

DeepSeek-V4-Flash-0731 284B inference in ~25 GB of RAM / Qwen3.8-Next-Flash inference in ~15 GB of RAM on any M-series MacBook