altic-dev / FluidVoice

Fastest and only macOS Dictation app with on-device STT and custom trained AI enhancement model. Windows, iOS testflight! Android, Linux waitlist open! A local Wispr Flow alternative. Follow https://x.com/fluidvoiceapp for more

FrizzleM / SideInstaller

An an app that installs Sidestore on iOS 27, fully on-device

zephyr4123 / speakmore

SpeakMore：免费开源的语音输入，Mac 和 Windows 都支持。模型任你接（Gemini、OpenAI、通义千问、DeepSeek、Kimi、智谱 GLM、MiniMax 或任何 OpenAI 兼容服务），也可以全部在本机跑、不上传数据。附对 Typeless 的逆向分析。

ozguradmin / ahenk-turkish-tts

Ahenk: açık Türkçe metinden sese. Open Turkish text-to-speech: VoxCPM2 LoRA (Ahenk), 8.6M on-device model (Ahenk Cep), trnorm text normaliser, TR-Zor benchmark

midagedev / mwoyeo

Live, in-place screen translation for macOS — a lens that rewrites the text under it in your language, on-device.

OpenStrap / edge

App which allows you to use your health devices beyond subscriptions. Supports Workout Tracking, Nutrition Tracking, Wellness Excercise, Sleep, Recovery, Strain, and Many more.

IPADS-SAI / Mobiinfer-Android

MobiInfer runs 35B-A3B-class MoE models fully on-device on the Qualcomm Hexagon NPU, streaming experts from flash with lookahead scheduling (LES) and DSpark speculation.

Goekdeniz-Guelmez / JOSIE-Voice

JOSIE Voice: a real-time, on-device voice assistant for Apple Silicon. Download the macOS app (DMG) from Releases.

shaom / keyboard-island

A playful typing adventure for kids: 96 chapters, collectible room decorations, and optional on-device face tracking.

1nikitas / NIKA_desktop

Native AI assistant for macOS, built with SwiftUI and llama.cpp. Run local LLMs offline, work with PDFs, and create custom AI assistants. Optional NIKA cloud integration.

google-ai-edge / gallery

A gallery that showcases on-device ML/GenAI use cases and allows people to try and use models locally.

alibaba / MNN

MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.

cactus-compute / needle

Automation foundation model for tiny devices: 2-bit, 8-29 MB, tool calls, ASR, structured extraction and embeddings on phones, wearables, smart homes, robots, cars and microcontrollers.

OpenBMB / MiniCPM

MiniCPM5: SOTA on-device LLMs, small yet powerful.

RunanywhereAI / runanywhere-sdks

Production ready toolkit to run AI locally

qualcomm / GenieX

Run frontier LLMs and VLMs locally on Qualcomm devices across NPU, GPU, and CPU with a few lines of code

drumih / turbo-fieldfare

Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook

google-ai-edge / LiteRT-LM

LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.

Arthur-Ficial / apfel

The free AI already on your Mac. CLI tool, OpenAI-compatible server, and interactive chat — all on-device via Apple Intelligence. No API keys, no cloud, no downloads.

argmaxinc / argmax-oss-swift

On-device Speech AI for Apple Silicon

cactus-compute / cactus

Quantization, kernels, runtime and inference engine for mobiles, wearables, smart home and robots.

maziyarpanahi / openmed

Local-first healthcare AI: clinical NER and HIPAA PII de-identification on hardware you control. 2,200+ medical models, 35 model-backed PII languages, and Python, MLX, Android and browser runtimes. Apache-2.0 SDK.

ARahim3 / DigUp

Search your computer by what's in your files: photos, PDFs, documents, recordings, videos and code. On-device on Mac, Windows and Linux, built on Google DeepMind's EmbeddingGemma 2.

pytorch / executorch

On-device AI across mobile, embedded and edge for PyTorch

Picovoice / porcupine

On-device wake word detection powered by deep learning

claration / feather

Free on-device iOS/iPadOS application manager/installer, using certificates part of the Apple Developer Program.

vinta / pangu.js

Opinionated paranoid text spacing in JavaScript, with on-device AI semantic judgment

thunderbird / thunderbolt

AI You Control: Choose your models. Own your data. Eliminate vendor lock-in.

objectbox / objectbox-java

Database for Android and JVM - first and fast, lightweight on-device vector database

tmoroney / auto-subs

On-device subtitle generation that connects directly to DaVinci Resolve, Premiere, and After Effects.

google-ai-edge / LiteRT

LiteRT, successor to TensorFlow Lite. is Google's On-device framework for high-performance ML & GenAI deployment on edge platforms, via efficient conversion, runtime, and optimization

nicedreamzapp / claude-code-local

Run Claude Code 100% on-device with local AI on Apple Silicon. MLX-native Anthropic-API server. 6 fighters incl. Muse-Glimmer 30B (now multimodal — reads images, abliterated), Gemma 4 31B, Qwen 3.5 122B (65 tok/s), DeepSeek V4 Flash (1M ctx). Private, offline, airgap-ready. Built for NDA / legal / healthcare workflows.

allenpeng0705 / EnvoyMesh

Decentralized P2P mesh for autonomous AI agents — self-sovereign identity, peer-to-peer chat, and on-device AI that negotiates tasks on your behalf. No central server.

pnnbao97 / VieNeu-TTS

Vietnamese TTS with instant voice cloning • On-device • Real-time CPU inference • 48kHz audio quality • Chuyển văn bản thành giọng nói tiếng Việt • Text to speech tiếng Việt • TTS tiếng Việt

StikDebug / StikDebug

An on-device debugger/JIT enabler for iOS versions 17.4+, powered by idevice.

microsoft / foundry-local

—

apple / coreai-models

Model export recipes, Python primitives, and Swift runtime utilities for on-device AI

omnimind-ai / OmniBot

Your on-phone / mobile AI Agent / Claw, capable of operating terminals and performing a wide range of tasks in the Android world || 你的手机 AI 代理，她可以操作终端，也可以完成 Android 世界的广泛任务

john-rocky / CoreML-Models

Core ML model zoo for iOS/macOS — PyTorch models converted to ready-to-use .mlpackage, each with a conversion script and SwiftUI sample app. Sibling repos cover Apple's Core AI framework (iOS/macOS 27) and on-device LLMs.

cosmo-wander-ai / cosmo-edge

Production-grade C++ edge AI engine for video analytics and on-device VLM across Sophon, Rockchip RKNN, and x86, with visual orchestration, real-time OSD, events, and reproducible benchmarks.

AhmadHassan-BTed / MotionShot

Camera app that freezes fast motion sequences into a single stroboscopic photo; powered by on-device computer vision, 2D stabilization, and manual exposure controls

TypeWhisper / typewhisper-mac

Local speech-to-text for macOS on-device AI, fully private, optional cloud

software-mansion / react-native-executorch

High-performance, privacy-first on-device AI inference library for React Native, powered by PyTorch's ExecuTorch runtime

mizorewww / laya-coreml

Local Laya typed decisions on Apple Core ML and Neural Engine. Validated ports, ~5 ms short decisions on M3 Max, reproducible speed and energy benchmarks.

nobodywho-ooo / nobodywho

NobodyWho is an inference engine that lets you run LLMs locally and efficiently on any device.

QwenAudio / Fun-ASR

Fun-ASR speech recognition models, with native Hugging Face Transformers support for Fun-ASR-Nano and separate FunASR, vLLM and llama.cpp deployment paths.

silverstein / minutes

Open-source, local-first Granola/Otter alternative that Claude Code, Codex, Cursor, and any MCP client can query. Meetings, calls, and voice memos transcribed on-device into markdown you own.

kuafuai / andee

Install one APK and it operates any app on your phone — reads the screen, taps buttons, types. No integrations, no root. Runs on-device, swap any model, your data stays on the phone.

Muesli-HQ / muesli

Muesli: agent-native local meeting transcription + dictation for macOS (Granola + WisprFlow alternative)

kizuna-ai-lab / sokuji

Real-time two-way speech translation for bilingual meetings — auto-detects the spoken language and translates both directions, cloud or fully offline on-device. Desktop (Windows · macOS · Linux) + browser extension (Chrome · Edge) for Zoom, Meet, Teams & any app.

ayushsharma82 / ESP-DASH

Blazing fast library to create a functional, on-device dashboard for ESP32, RP2040+W and RP2350+W microcontrollers

apple / python-apple-fm-sdk

Python bindings for access to the on-device model at the core of Apple Intelligence through the Foundation Models framework

DavidVentura / offline-translator

Use Firefox Translation Models for on-device translation on Android

soniqo / speech-swift

AI speech toolkit for Apple Silicon — ASR, TTS, speech-to-speech, VAD, and diarization powered by MLX and CoreML

perplexityai / numbat

Visibility into AI agent activity on endpoints, with on-device detection, optional pre-action blocking, and forensic reconstruction.

orailnoor / cross-platform-llm-client

A unified cross-platform AI client supporting seamless transitions between standard cloud APIs and on-device, offline execution of custom and uncensored language models.

ciddwd / overlay-translator

无需 ROOT 的开源 Android 屏幕实时翻译工具，适合游戏、视觉小说和漫画。支持端侧与云端 OCR、离线 LLM、多种翻译服务和文字朗读（TTS），译文可直接显示在画面上。Open-source no-root Android real-time screen translator for games, visual novels, and manga. Supports on-device and cloud OCR, offline LLMs, multiple translation services, on-screen translations, and text-to-speech (TTS).

OpenSparX / MasterAgent

Build AI agents that run 100% on-device. Sub-100ms latency on Qualcomm NPU. Zero cloud dependency.

kennss / SiliconScope

Sudoless Apple Silicon system monitor (native SwiftUI GUI) with ANE / Media Engine / memory-bandwidth tracking

feder-cr / jev

jevos: an open-source alternative to Jev and Microsoft-Decision-1. Yes/no decisions, choices and scores with probabilities, on your laptop's CPU.