StartLuxLabs / StartLux-Decision

Open decision models from 0.8B to 27B: a calibrated probability for every option in one pass, and a short thought only when unsure. Engine for vLLM, llama.cpp and MLX.

practical-tutorials / project-based-learning

Curated list of project-based tutorials

sgaofen / humanizer-local-model

Rewrites AI drafts so they read like a person wrote them — runs locally, keeps the facts

Osmantic / ODS

ODS V3 Pre-Release: Public testing and refinement ahead of the official V3 launch. Turn your PC, Mac, or Linux box into a private AI server.

vyanhursky / DefJamFFNY-recomp

Def Jam: Fight for NY PC port — static recompilation of the original Xbox game for native Windows and macOS (Direct3D 11 / Vulkan). Bring your own game dump.

rabbitfiremediacreation / music-generator

Eigene Songs lokal erzeugen, auf Mac (Apple Silicon, Metal), Windows (NVIDIA) und Linux (Arch, AMD/NVIDIA/Intel): Web-App für ACE-Step 1.5 über acestep.cpp, mit Installer

noonghunna / club-3090

Community recipes for serving LLMs on RTX 3090/4090/5090 CUDA gpus. Multi-engine (vLLM, sglang, llama.cpp and other custom engines) and model-agnostic. Currently shipping Qwen3.8-27B Qwen3.6 35B Gemma 4 26B Gemma 4 31B configs for 1×/2×/4x/8x cards.

StayLameBro / backburner

Your iPhone helps your Mac run a 27B model: faster prompt reading and more context over a USB-C cable

SFTtech / openage

Clone of the Age of Empires II engine 🚀

conan-io / conan

Conan - The open-source C and C++ package manager

thetahealth / mirobody

Turn scattered health data into answers you can trace. Self-hosted AI health data engine for lab reports, wearables and genetics, with a built-in MCP server. Run it with Docker and one LLM key, or keep every model local on llama.cpp.

PyVRP / PyVRP

Open-source, state-of-the-art vehicle routing problem solver in an easy-to-use Python package.

ShrugYu / game-client-to-server-reverse

从游戏客户端反推服务端协议并复现可部署服务端 (Agent Skill)。Unity/UE/Cocos, IL2CPP/Lua/JS…

nistordarius26h-ship-it / ga_ai_robot

Globally accessible autonomous robot featuring AI object tracking, 4G remote control, edge computing, WebRTC streaming, and environmental sensing.

Ericsson / codechecker

CodeChecker is an analyzer tooling, defect database and viewer extension for static and dynamic analyzer tools.

spark-arena / sparkrun

sparkrun - launch, manage, and stop LLM inference workloads on NVIDIA DGX Spark systems. Live support: https://discord.com/invite/GH5kRgv6ZD

sudoingX / qwen38-mtp

One llama.cpp flag unlocks +33-39% decode speed for Qwen3.8-27B on consumer GPUs. The MTP head already ships inside your GGUF. Recipe, paired benchmarks, probe tool.

sudoingX / local-ai-on-your-gaming-gpu

run a 27b local ai on your gaming gpu, rtx 3060 and up, radeon rx 6600 and up in beta, 8gb or more, linux and windows, one line to install

professorpalmer / bonsai-ada-surgery

Bonsai 2 27B: 262k context (trained max) on 12 GB, 54 to 97 tok/s decode, 2x prefill, q8_0 KV recipe, grammar tool calls 9/9. Same ternary weights. Windows bundle + receipts.

lvxworld / lux-in-music

Create songs from lyrics and a style on your own computer. Local AI music studio with YuE2 via audio.cpp, stem separation and section editing.

estebanstifli / Meet2Notes

Private, local-first AI meeting assistant for transcription, speaker diarization and meeting notes. Open-source, self-hosted alternative to Granola, Meetily, Fireflies.ai, Fathom and Otter.ai.

sjespersen / homelab-agent

Started as a €70 used mini PC running an always-on AI agent (Hermes, n8n, Pi-hole, monitoring, Tailscale, encrypted backups). Now with a second stack next to it: a homelabbed GPU server for local AI (Qwen 27B and Flash-Next, image generation, Ollama, one API). All as code.

llmware-ai / llmware

Unified framework for building enterprise RAG pipelines with small, specialized models

abetlen / llama-cpp-python

Python bindings for llama.cpp

xorbitsai / inference

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

LearningCircuit / local-deep-research

~95% on SimpleQA (e.g. Qwen3.6-27B on a 3090). Supports all local and cloud LLMs (llama.cpp, Ollama, Google, ...). 10+ search engines - arXiv, PubMed, your private documents. Everything Local & Encrypted.

flwrlabs / flower

Flower: A Friendly Federated AI Framework

rapidfuzz / RapidFuzz

Rapid fuzzy string matching in Python using various string metrics

KoboldAI / KoboldAI-Client

For GGUF support, see KoboldCPP: https://github.com/LostRuins/koboldcpp

containers / ramalama

RamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and facilitates their use for inference in production, all through the familiar language of containers.

antoinezambelli / forge

A Python framework for self-hosted LLM tool-calling and multi-step agentic workflows

deepmodeling / deepmd-kit

A deep learning package for many-body potential energy representation and molecular dynamics

cpplint / cpplint

Linter for C++ based on Google's style guide

conan-io / conan-center-index

Recipes for the ConanCenter repository

pytorch / extension-cpp

C++ extensions in PyTorch

Woolverine94 / biniou

a self-hosted webui for 30+ generative ai

mobilityhouse / ocpp

Python implementation of the Open Charge Point Protocol (OCPP).

gcovr / gcovr

Generate code coverage reports with gcc/gcov

VocaHQ / vocalinux

Free, open-source, 100% offline voice dictation for Linux. Speak and type anywhere via whisper.cpp, Whisper & VOSK engines, GPU-accelerated, works on X11 + Wayland!

lemonade-sdk / llamacpp-rocm

Fresh builds of llama.cpp with AMD ROCm™ 7 acceleration

kaityo256 / sevendayshpc

一週間でなれる！スパコンプログラマ

hogan-tech / leetcode-solution

Explore diverse LeetCode solutions in Python, C++, JavaScript, SQL, and TypeScript. Ideal for interview prep, learning, and code practice in multiple programming languages.

Yzw202011 / OmniSpace

本地优先的全栈 AI 创作工作站：AI对话 · AI漫画 · 漫剧创作 · 写作台 · 知识学习五大模块；vLLM / llama.cpp / Transformers 多引擎本地推理，显存智能调度、舱壁隔离自愈、仅供学习使用，欢迎交流指正。（最新进度（除插件系统）受到协议限制，暂时无法提交到仓库）

Rose22 / openlumara

handwritten harness for AI, not vibecoded, everything is a module/plugin, tailor made for use with local models, tiny system prompt (around 1k by default), support for exclusive llamacpp features, strong security, strict zero-trust-in-the-ai policy (the code hard limits the ai, no amount of prompt engineering will bypass it)

Speedstu / CUDA-for-AMD-Windows

Run CUDA-targeted Windows applications on AMD GPUs with ZLUDA + ROCm/HIP.

ThinkOffApp / CarWatch

Your car as a chat-room agent: Raspberry Pi 5 + dashcam + local AI. CodeWatch's sibling for the garage.

julianmb / q38rocm

Qwen 3.8 27B ROCmFP4 on AMD Strix Halo (Ryzen AI Max+ 395). Up to 36 tok/s via MTP Speculation, TurboQuant & Mesa RADV Wave64.

B0yko / tern

Local AI search for podcast and video archives on Apple Silicon: Whisper speech, Apple Vision OCR and SigLIP-2 visual search fused into one ranked list, with a trim editor and FCPXML export. FastAPI, vanilla JS, Tauri. Source-visible, all rights reserved.

Nathanw1014 / strix-halo-llamacpp

Performance-tuned llama.cpp for AMD Strix Halo (gfx1151): FA + MoE-prefill fixes with a bundled current Mesa driver. Vulkan and HIP; portable dir, Docker, and distrobox.

SergiioB / intel-arc-pro-b70-inference-cookbook

Open recipes, engine patches, and benchmark harnesses for LLM inference on Intel Arc Pro B60/B70 (Battlemage, Xe2). MoE 35B at 160 t/s decode / 7.5K t/s prefill single-stream, 27B at 50~ t/s decode / 1.7K t/s prefill single stream. vLLM XPU MTP unlocked. Muse Glimmer recipe added!!

Blackwellboy / model-serving-minefield

Community registry of LLM serving-path traps that produce confidently wrong measurements: templates, tool parsers, reasoning fields, quant kernel paths, CUDA toolchains, KV allocation, eval harnesses, versioning. Symptom-first, with the check that catches each.

kevinbadi / jev-voice

Talk to your Mac. Local whisper.cpp + one Jev (TypeSafe) call per command + macOS automation.

pcppcp / op1r

Patches for the original OP1 r246 firmware. New synths, drum, fxs, sequencers. Sample editor, improved tape tools and other cool features & bugfixes. Use at your own risk & have fun.

htobty / ReadyLLM

Deploy, monitor, and tune LLM through a visual interface — plus image / video generation on top of ComfyUI.

ssyclr / zygisk-mcp-il2cpp

一个MCP服务

julianmb / halofpx

High-performance Lemonade alternative for AMD Strix Halo & Radeon — latest MoE models (Ling-3.0-Flash, Qwen 3.8 Flash Next, Ornith 1.5), bleeding-edge RDNA 3.5 Wave64/ROCmFP4 kernels, and silicon-tuned profiles.

hclivess / whisperer

Batch subtitle generator GUI for video/audio — Whisper via faster-whisper or whisper.cpp (PySide6)

monatis / ggmlc

A multi-framework neural network compiler lowering PyTorch, JAX, Flax, and Keras models to portable, high-performance GGML execution

jceronch1 / Clonar-voz

Clonación de voz y texto a voz 100% local con Qwen3-TTS y llama.cpp. Funciona en CPU y GPU, 10 idiomas, interfaz web en español.

trademav / ramdeck-core-public

Pool RAM across old PCs, Macs, and Android devices into a unified local AI cluster