andrisgauracs / whistle-esp32
Whistle speech-to-text running fully on an ESP32-S3: hold a button, say a colour in one of 7 languages, the LED does it. No network.
andrisgauracs / whistle-esp32
nats-io / nats-server
High-Performance server for NATS.io, the cloud and edge native messaging system.
cactus-compute / needle
Automation foundation model for tiny devices: 2-bit, 8-29 MB, tool calls, ASR, structured extraction and embeddings on phones, wearables, smart homes, robots, cars and microcontrollers.
ultralytics / yolov3
PyTorch implementation of YOLOv3, YOLOv3-SPP, and YOLOv3-tiny for real-time object detection with training, validation, inference, and multi-format export.
google-ai-edge / LiteRT-LM
LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.
cactus-compute / cactus
Quantization, kernels, runtime and inference engine for mobiles, wearables, smart home and robots.
memovai / mimiclaw
MimiClaw: Personal Agent on a $5 chip. No OS(Linux). No Node.js. No Mac mini. No Raspberry Pi. No VPS. Hardware agents OS. On device Muse.
beclab / Olares
Open-Source Personal Cloud OS for Always-On Agents
0xShug0 / audio.cpp
An all-in-one, pure C++ inference engine for audio models, powered by ggml. Supports TTS, STT, VAD, voice conversion, music generation, and more, with highly optimized performance. No Python dependency.
off-grid-ai / OGAM
The Swiss Army Knife of Offline AI. Chat, see, speak, and generate images on your phone or Mac β GGUF LLMs, vision, Whisper speech-to-text, Stable Diffusion, tool calling, and local-network servers. Runs on your CPU, GPU, or NPU. No account, no API key, zero data leaves your device.
cosmo-wander-ai / cosmo-edge
Production-grade C++ edge AI engine for video analytics and on-device VLM across Sophon, Rockchip RKNN, and x86, with visual orchestration, real-time OSD, events, and reproducible benchmarks.
usamahz / cpu-performance-engineering
A reading path for CPU performance engineering, from one instruction to production inference. Primary sources only, with a runnable benchmark for every section.
microsoft / Biodiversity
Microsoft AI for Good Lab β Biodiversity research hub. Open-source AI models, edge devices, and tools for biodiversity monitoring and conservation. Your source for MegaDetector, SPARROW, PytorchWildlife, Bioacoustics, and more.
OpenSparX / MasterAgent
Build AI agents that run 100% on-device. Sub-100ms latency on Qualcomm NPU. Zero cloud dependency.
feder-cr / jev
jevos: an open-source alternative to Jev and Microsoft-Decision-1. Yes/no decisions, choices and scores with probabilities, on your laptop's CPU.
LibreYOLO / libreyolo
LibreYOLO is a MIT licensed open source computer vision library
sourcenetwork / defradb
DefraDB is a Peer-to-Peer Edge-First Database. It's the core data storage system for the Source Ecosystem.
sipeed / MaixPy
Easily create AI projects with Python on edge device
fluxions-ai / vui
Vui Nano β a small, context-aware text-to-speech model trained on real conversations. 219M active params (305M total), Apache 2.0, voice cloning, streaming, runs on CPU (dependency-free C build). Ships with a full real-time voice assistant: WebRTC, ASR, local LLM, OpenAI Realtime API compatible.
hailo-ai / hailo_model_zoo
The Hailo Model Zoo includes pre-trained models and a full building and evaluation environment
Picovoice / speech-to-text-benchmark
speech to text benchmark framework
DenisovAV / flutter_edge_ai
On-device AI for Flutter β Gemma and other LLMs, multimodal, function calling, embeddings, RAG and speech on Android, iOS, Web, macOS, Windows and Linux.
Helldez / BigMoeOnEdge
Run MoE models bigger than your RAM. Frontier-size MoE on a phone, laptop, edge. Lossless, on stock llama.cpp. An adaptive streaming optimizer. Any hardware, any OS, any model, any quantization, behind a local OpenAI-compatible server.
qijianpeng / awesome-edge-computing
A curated list of awesome edge computing, including Frameworks, Simulators, Tools, etc.
ThinkOffApp / CarWatch
Your car as a chat-room agent: Raspberry Pi 5 + dashcam + local AI. CodeWatch's sibling for the garage.
RUSEGAL / ruseon-core
Edge video infrastructure in Go for CCTV β RTSP ingest, HLS/WebRTC streaming, fMP4 recording, timeshift and AI metadata pipelines.
raullenchai / esp32-thinks
A multi-model Muse: personal AI voice assistant on ESP32 - wake word or knob, any OpenAI-compatible brain (STT/chat/TTS mix-and-match), streaming replies, out of the box. Built on muse-gadget-sdk.
lotvulture / lotvulture
Real-time parking lot occupancy detection using existing security cameras and on-device computer vision.
lokutor-ai / oido
OΓdo: open-vocabulary speech recognition that fits in a $5 ESP32-S3. 3.7% LibriSpeech WER, no cloud, no NPU.
Intellindust-AI-Lab / GTR
GTR: Gated Token Recurrence for Efficient Dense Prediction
wladimiravila / esp32s3-distributed-ai
Distributed 56M-parameter LLM inference across 3 ESP32-S3 boards via ESP-NOW , Split-PLE + KV cache, fully offline.
Heman10x-NGU / Verdict-open-jev
Non-autoregressive decision engine on ModernBERT (151M) with calibrated uncertainty (RLCD), TypeSafe AI Jev benchmark audit, and in-browser WebGPU playground
AbrahamPaulJ / facefusion-mobile
FaceFusion for Android. Offline face swap running on the phone's NPU, GPU or CPU. Qualcomm Hexagon (v68 to v81), Vulkan fallback, no server and no upload.
AbrahamPaulJ / nightmare-mobile
On-device ComfyUI style node graph for image/video diffusion models on Android. Local SD1.5, SDXL, Flux, Z-image, Anima, Qwen Image 2.1, Krea 2, MOSS Image, Ideogram 4, inpainting, outpainting, controlnet, LoRA, IPAdapter, auto-segment and WAN 2.2 5B video on the Qualcomm Hexagon NPU. Fully offline, no server, no account.
AydinAdnan / PulseVAD
Ultra-tiny 2.1k streaming voice activity detector (2.1 KB INT8). 200 ms window for microcontrollers, edge devices, and DSPs. ships with ONNX, TorchScript, and standalone C header.
chilly23 / RP2040-and-ESP32-AI
Run a 28.9M-parameter TinyLM on ESP32-S3 with an RP2040 OLED display node for fully local embedded AI inference.
tlack / babytalk
Optimized ESP32-S3/P4 fully offline speech to text and text to speech system for Micropython and AtomVM, featuring a finetuned STT model for noisy environments, plus a data generation/field capture/model finetuning framework. Includes high performance 4/8bit int kernels for Xtensa/RiscV PIE vector units
fotonik-sk / stm32n6-speech-recognition
Offline speech-to-text on the STM32N6 microcontroller: free English speech recognition on the NPU, no cloud
sauravsingla / MemVanta
Low-memory C++20 LLM inference runtime for quantized GGUF models on CPU β mmap-backed weights, paged KV cache, Q4/Q8 kernels, and reproducible llama.cpp benchmarks.
kjckangshifu / ML-Sharp-QNN
Port Apple's SHARP (single-image 3D Gaussian Splatting) to on-device Android via Qualcomm QNN HTP β fully offline inference on Snapdragon
yzfly / edgejev
离线ε―η¨ηζ¬ε°η±»εεε³ηοΌ4 ζ Έ CPU ει’ 15.6msγLocal & offline Jev / System One inference on CPU β ONNX + INT8, no torch at runtime. ζ―ζ laya / kev / PlayJev
usamahz / make-your-model-fast
A Systems View of Efficient Machine Learning, from Silicon to Agents. Fourteen parts, from roofline analysis and vector units up through kernels, compilers, quantisation, compression, vision, on-device language models, robotics, profiling, serving and agents.
lokutor-ai / ito
Natural-sounding streaming text-to-speech for the ESP32-S3: 4.4 M params, 4.9 MB, no cloud, no NPU
AndreiiArhire / LightMIS
LightMIS: Ultra-Lightweight Medical Image Segmentation Without a Stage-Wise Decoder