lyogavin / airllm
Python library that runs large language model inference layer by layer, so 70B-class models fit on a single 4GB GPU without quantization.
lyogavin / airllm
ollama / ollama
Runs open-weight LLMs such as Gemma, Qwen, DeepSeek, and gpt-oss locally or in the cloud, with a CLI, REST API, and Python and JavaScript libraries.
vllm-project / vllm
A high-throughput LLM inference and serving engine featuring PagedAttention, continuous batching, and an OpenAI-compatible API server.
LiCinCan / blender-ai-mcp-addon
AI assistant and MCP server for Blender: visual chat, scene tools, multi-agent workflows. Works with OpenAI, ChatGPT, Claude, Gemini, Ollama, OpenCode. Blender AI addon and plugin, copilot for 3D, bpy Python scripting, MCP integration.
AstrBotDevs / AstrBot
AI Agent Assistant & development framework that integrates lots of IM platforms, LLMs, plugins and AI feature, and can be your openclaw alternative. ✨
StartLuxLabs / StartLux-Decision
Open decision models from 0.8B to 27B: a calibrated probability for every option in one pass, and a short thought only when unsure. Engine for vLLM, llama.cpp and MLX.
Tencent / WeKnora
Open-source LLM knowledge platform that turns documents into a searchable RAG system, a multi-step reasoning agent, and a maintained wiki.
multimodal-art-projection / YuE
YuE2: frontier music generation with symbolic planning, zero-shot covers, and agentic music editing.
ggml-org / llama.cpp
LLM inference in C/C++
mudler / LocalAI
Open-source local AI engine that runs LLMs, vision, voice, image, and video models behind OpenAI-compatible APIs on CPU or GPU.
llamaboi55 / DragShift
Convert and edit files with a liquid-glass radial menu: start dragging a file, press Shift, drop it on a slice. Windows, Mac and Linux.
altic-dev / FluidVoice
Open source macOS dictation app that transcribes speech on-device and optionally enhances the text with a local AI model.
ARahim3 / DigUp
Search your computer by what's in your files: photos, PDFs, documents, recordings, videos and code. On-device on Mac, Windows and Linux, built on Google DeepMind's EmbeddingGemma 2.
mnfst / awesome-free-llm-apis
A curated list of LLM APIs that offer permanent free tiers for text inference, with base URLs, models, and rate limits.
open-webui / open-webui
User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
sgl-project / sglang
SGLang is a high-performance serving framework for large language models and multimodal models.
lidge-jun / opencodex
Universal provider proxy for OpenAI Codex & Claude Code — use any LLM (Claude, Gemini, Grok, DeepSeek, Ollama…) with Codex CLI, App, SDK, and Claude Code
langfuse / langfuse
🪢 Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform.
ddalcu / mlx-serve
Native macOS and Apple Silicon inference server exposing OpenAI, Anthropic and Ollama APIs, with a Swift app, written in Zig.
justxor / deepseek-local-guide-ru
🐋 Полный гайд на русском: как установить и запустить DeepSeek локально (V4, R1) на ПК, Mac и сервере — Ollama, llama.cpp, LM Studio, vLLM, Open WebUI, API, RAG, агенты, fine-tuning, лучшие фишки
unslothai / unsloth
Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4.1, MiniMax-H3, Gemma 4, FLUX and more.
MakazhanAlpamys / Soup
Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.
datawhalechina / all-in-rag
🔍大模型应用开发实战一：RAG 技术全栈指南，在线阅读地址：https://datawhalechina.github.io/all-in-rag/
langbot-app / LangBot
Production-grade platform for building agentic IM bots - 生产级多平台智能机器人开发平台/ Agent、知识库编排、插件系统 / Bots for Discord / Slack / LINE / Telegram / WeChat(企业微信, 企微智能机器人, 公众号) / 飞书 / 钉钉 / QQ / Matrix e.g. Integrated with ChatGPT(GPT), DeepSeek, Dify, n8n, Langflow, Coze, Claude, Gemini, GLM, Ollama, SiliconFlow, Kimi, openclaw / hermes agent, deerflow
magnitudedev / magnitude
Open source inference engine that tunes its kernels on your hardware to find the fastest way to run each model. 2x faster than Ollama. Works on Apple Silicon, NVIDIA, AMD, or just a CPU.
ovg-project / kvcached
Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond
T-Crypt / berth
Decides who gets your GPU. Chat, image and voice engines lease the card in turn instead of grabbing it, so two of them never load at once and crash each other. One Go binary, nothing else to install.
NirDiamant / RAG_Techniques
A collection of 42+ runnable Jupyter notebooks, each tutorial covering an advanced technique for Retrieval-Augmented Generation systems.
georgevibing / conch-agent
🐚 The AI assistant that just works. One self-hosted app for every model you already pay for: Claude Code, Codex, Copilot, Gemini, Ollama and more. Chat from your desktop, phone or Telegram.
Significant-Gravitas / AutoGPT
AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.
PDFMathTranslate / PDFMathTranslate
[EMNLP 2025 Demo] PDF scientific paper translation with preserved formats - 基于 AI 完整保留排版的 PDF 文档全文双语翻译，支持 Google/DeepL/Ollama/OpenAI 等服务，提供 CLI/GUI/MCP/Docker/Zotero
hiyouga / LlamaFactory
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
AAswordman / Operit
The most powerful AI agent and AI chat software on Android/Operit是一款Android上能力最为强大、发展最久的AI Agent
The-PR-Agent / pr-agent
🚀 PR Agent: The Original Open-Source PR Reviewer. This project is not the Qodo free tier.
EthanYoQ / AI-Novel-Writer
书童 Pagekin（原名 AI 小说作家）：开源免费的 AI 长篇小说写作桌面软件，从设定、蓝图到正文、审稿、定稿；支持拆解仿写、续写、改写，可导入写作 Skill（如去 AI 味）。模型需自行配置，作品在本地。Pagekin (formerly AI Novel Writer): free, open-source AI novel writing app for long novels and web fiction. Imitate, continue, rewrite; import writing skills. Local-first, no model bundled. Windows & macOS.
sgaofen / humanizer-local-model
Rewrites AI drafts so they read like a person wrote them — runs locally, keeps the facts
dragonked2 / alphacode
Free MIT AI coding agent — no API key needed. Built-in free model, or bring Claude, GPT, Gemini, DeepSeek, Ollama +50 more. Swarm mode, 40+ tools, browser & desktop automation, built in Rust.
marcolamaia / MarcFlow
MarcFlow — automação de WhatsApp com fluxos visuais, campanhas, grupos e respostas rápidas. Por Marcos Maia (@marcolamaia).
2430816465 / campus-knowledge-agent
校园知识服务 Agent 智能体平台：基于 FastAPI、Qwen3 与 RAG，贯通公开资料解析、时间范围检索、证据溯源及人工审核。
huggingface / agents-course
This repository contains the Hugging Face Agents Course.
yamadashy / repomix
📦 Repomix is a powerful tool that packs your entire repository into a single, AI-friendly file. Perfect for when you need to feed your codebase to Large Language Models (LLMs) or other AI tools like Claude, ChatGPT, DeepSeek, Perplexity, Gemini, Gemma, Llama, Grok, and more.
juinwei7 / Shiyin
Free, open-source meeting notes app for Mac: records Zoom, Meet and Teams without a bot, transcribes on-device (whisper.cpp + Breeze ASR 25), identifies speakers, and writes timestamped notes with your own Claude or ChatGPT. 拾音
fishaudio / fish-speech
SOTA Open Source TTS
YeonwooSung / llm-architecture-from-scratch
Implementing LLM architectures from scratch in PyTorch
AienTech / dossier
A self-hosted job search app that writes tailored resumes and cover letters from your profile.
run-llama / llama_index
LlamaIndex is the document processing platform for AI
comet-ml / opik
Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.
browseros-ai / BrowserOS
🌐 The open-source Agentic browser; alternative to ChatGPT Atlas, Perplexity Comet, Dia.
StarTrail-org / LEANN
[MLsys2026 Best Paper]: https://arxiv.org/abs/2506.08276. RAG on Everything with LEANN. Enjoy 97% storage savings while running a fast, accurate, and 100% private RAG application on your personal device.
Osmantic / ODS
ODS V3 Pre-Release: Public testing and refinement ahead of the official V3 launch. Turn your PC, Mac, or Linux box into a private AI server.
chenxiachan / thoughtdag
Your thinking deserves a map: an infinite canvas where LLM conversations grow into an editable thought graph. Wires are the context.
cobanov / PS5LM
llama.cpp on a jailbroken PS5: run any GGUF model natively on the console, starting with Qwen 3.8
koalaman / shellcheck
ShellCheck, a static analysis tool for shell scripts
teslamate-org / teslamate
A self-hosted data logger for your Tesla 🚘 [main maintainer=@JakobLichterfeld]
JerryZLiu / Dayflow
The automatic work journal/time tracker. Privately turns your screen into a timeline of what you actually accomplished. Open-source and local-first.
lemonade-sdk / lemonade
Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk
AtomicBot-ai / atomic-agent
Atomic Agent is a local-first AI agent. Runs open-weight models on your own machine via llama.cpp.
maximpri / mlxtop
A top for local LLMs: memory, paging, GPU and tokens/s for oMLX, Ollama, llama.cpp, vLLM and more
midagedev / bloomery
Hybrid GPU + CPU inference for mixture-of-experts models, written in Rust down to the CUDA kernels. A drop-in llama-server.
dataelement / bisheng
BISHENG is an open LLM devops platform for next generation Enterprise AI applications. Powerful and comprehensive features include: GenAI workflow, RAG, Agent, Unified model management, Evaluation, SFT, Dataset Management, Enterprise-level System Management, Observability and more.