mmm1712 / Local_AI_esp32
A language model trained from scratch and running offline on an ESP32-S3 with a touchscreen chat interface.
mmm1712 / Local_AI_esp32
FareedKhan-dev / kimi-k3-in-c
A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.
onehumanbeing / esp32-iphone-agent
Let an AI model use a real iPhone with a $7 ESP32: AirPlay eyes, USB HID hands, any OpenAI-compatible vision model. No Mac, no developer account, no jailbreak.
tuya / TuyaOpen
Next-gen AI+IoT framework for T2/T3/T5AI/ESP32/and more – Fast IoT and AI Agent hardware integration
QwenAudio / Fun-ASR
Fun-ASR speech recognition models, with native Hugging Face Transformers support for Fun-ASR-Nano and separate FunASR, vLLM and llama.cpp deployment paths.
mybigday / llama.rn
React Native binding of llama.cpp
microsoft / Tutel
Tutel MoE: Optimized Mixture-of-Experts Library, Support GLM/Kimi/Gpt/DeepSeek/Qwen using FP8/NVFP4/MXFP4
OleksandrChekhovskyi / hax
A minimalist, terminal-native coding agent written in C.
eunomia-bpf / agentsight
lightweight system-level observability for AI Agents
jordanhubbard / nanolang
A tiny experimental language designed to be targeted by coding LLMs
timmyy123 / LLM-Hub
Local LLM, image&video&music generator, run codex with local models on your phone
prabanta-dev / janas
37 tok/s from Qwen3-Next-80B (48 GB) on a 32 GB laptop, 24 without drafts vs 2.8 for llama.cpp; reading 62 vs 16 tok/s. Faster than llama.cpp on all 13 models compared in Q4_K_M. LLMs bigger than your RAM, pure C, CPU or GPU.
mediacutlet / pocket-tank
A 14M-parameter LLM keeps a virtual fish tank alive on an $8 ESP32-S3 — distilled from a 26B teacher into 7.56 MB, no network.
andrisgauracs / needle-2-esp32
A 45M-parameter LLM: needle 2 running fully offline on an ESP32-S3, turning plain-English requests into guaranteed-valid JSON tool calls.
JustVugg / lumabri
Run large AI models across your computers and servers. Powered by Colibri. Pure C.
wladimiravila / esp32s3-distributed-ai
Distributed 56M-parameter LLM inference across 3 ESP32-S3 boards via ESP-NOW , Split-PLE + KV cache, fully offline.
memovai / mimimodel
MimiModel: Agentic LLM on a $5 chip. 100% on-device. Private by design.
iamankushpandit / esp_ai
Fully offline voice assistant on ESP32-S3 (Freenove FNK0104B): free-form STT, tiny LLM, TTS https://iamankushpandit.github.io/esp_ai/
Geramy / LemonSeed-Studio
An iPad IDE with local LLM inference on an AMD GPU over Thunderbolt: the upstream Linux amdgpu driver embedded as DriverKit, LemonSeed Engine, and live GPU telemetry.
baker27727 / ds4-8gb-cpu
DeepSeek V4 Flash CPU/NVMe research fork: 78.62 GiB GGUF validated on 7.7 GiB RAM, CPU-only, using demand paging.
BareiroJorge / esp32-llm-commands
—
simoneiacomino / xenolith
A pure C inference engine designed for Intel Xe-LP iGPUs and Gemma 4 26B-A4B QAT.
baryhuang / llm-in-c
LLM inference in C, compiled per model and per chip. Up to 14x faster.
shyringo / deepseek-v4-flash-0731-in-c
Run the native 284B-A13B DeepSeek-V4-Flash-0731 LLM locally on one laptop CPU: pure C, 8 GB RAM minimum, no GPU, best TPOT 0.892 s/token, resident OpenAI-compatible API with function tools. | 在笔记本单颗 CPU 上本地运行原生 284B-A13B DeepSeek-V4-Flash-0731 大模型：纯 C，最低 8 GB 内存，无需 GPU，最优 TPOT 0.892 秒/token，支持模型常驻的 OpenAI 兼容接口与函数工具。
thatblend / LLMPSP
A custom LLM runtime for the Sony PSP, running a 90M parameter language model locally.
offpolicyinc / wc3env
Gym-style environment for Warcraft III Legacy: stepping, observations and commands through an injected DLL