LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.
The most advanced, fully offline client-side AI suite on Android today.
Turn your Android phone into an OpenAI-compatible LLM inference server - Fully local, private and Open Source
Open-source Android AI using LiteRT-LM with hardware acceleration, cloud providers, memory, and voice.