google-ai-edge / LiteRT-LM

LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.

google-ai-edge / LiteRT

LiteRT, successor to TensorFlow Lite. is Google's On-device framework for high-performance ML & GenAI deployment on edge platforms, via efficient conversion, runtime, and optimization

SimonSchubert / Kai

OpenClaw alternative in your pocket

DenisovAV / flutter_edge_ai

On-device AI for Flutter — Gemma and other LLMs, multimodal, function calling, embeddings, RAG and speech on Android, iOS, Web, macOS, Windows and Linux.

google-ai-edge / litert-torch

Support PyTorch model conversion with LiteRT.

jegly / Box

The most advanced, fully offline client-side AI suite on Android today.

NightMean / OlliteRT

Turn your Android phone into an OpenAI-compatible LLM inference server - Fully local, private and Open Source

krrishnarraj / clpeak

Peak compute, memory bandwidth and latency of CPUs, GPUs and NPUs: the same tests through every API that reaches a device. Command line and app for Windows, macOS, Linux and Android

ultralytics / yolo-flutter-app

Official Ultralytics YOLO Flutter plugin for real-time inference on Android and iOS across major vision tasks.

ShadowSafin / AndroLLM

Open-source Android AI using LiteRT-LM with hardware acceleration, cloud providers, memory, and voice.

PINTO0309 / soma

Structured Output Matching & Association: online multi-person tracking built on the structured output of a multi-task wholebody detector, one whole-frame pass per frame (plus per-crop ReID embeddings in SOMA-R) — no tiling, no offline post-processing.