xerj-org / xerj
Local-first search engine and MCP server in one Rust binary, indexing code, docs, logs and PDFs for BM25, vector and hybrid search.
xerj-org / xerj
tashfeenahmed / freellmapi
Self-hosted OpenAI-compatible proxy that routes requests across free-tier LLM providers with failover and encrypted key storage.
mksglu / context-mode
MCP server that keeps raw tool output out of AI coding agent context windows and persists session state across compaction.
thesysdev / openui
OpenUI is a framework-agnostic Generative UI framework with a streaming-first language for rendering model-generated interfaces.
lyogavin / airllm
Python library that runs large language model inference layer by layer, so 70B-class models fit on a single 4GB GPU without quantization.
ollama / ollama
Runs open-weight LLMs such as Gemma, Qwen, DeepSeek, and gpt-oss locally or in the cloud, with a CLI, REST API, and Python and JavaScript libraries.
android / skills
Modular SKILL.md instructions that ground AI agents in Android development best practices from developer.android.com.
vllm-project / vllm
A high-throughput LLM inference and serving engine featuring PagedAttention, continuous batching, and an OpenAI-compatible API server.
Alishahryar1 / free-claude-code
A local proxy that lets Claude Code, Codex, OpenCode and other coding agents run on free or alternative model providers.
ranxianglei / billion-context
A TypeScript proxy plugin that sits between coding agents and model APIs, compressing conversation history into reversible layered summaries.
DeusData / codebase-memory-mcp
Local MCP server that builds a persistent knowledge graph of code, docs, and infrastructure for AI coding agents and developers.
Lordog / dive-into-llms
Chinese-language hands-on programming tutorial series on large language models, covering fine-tuning, prompting, editing, watermarking, jailbreaks, and agents.
microsoft / generative-ai-for-beginners
A 21-lesson Microsoft course teaching how to build generative AI applications, with code examples in Python and TypeScript.
mnfst / awesome-free-llm-apis
A curated list of LLM APIs that offer permanent free tiers for text inference, with base URLs, models, and rate limits.
sgl-project / sglang
SGLang is an open-source inference framework for serving large language, vision-language, and diffusion models.
QuantumNous / new-api
Self-hosted AI gateway that exposes one API to clients while routing requests to multiple upstream model providers.
mudler / LocalAI
Open-source local AI engine that runs LLMs, vision, voice, image, and video models behind OpenAI-compatible APIs on CPU or GPU.
ScrapeGraphAI / Scrapegraph-ai
Python library that uses LLMs and graph-based pipelines to extract structured data from websites and local documents from a natural-language prompt.
HandsOnLLM / Hands-On-Large-Language-Models
Code examples for the O'Reilly book Hands-On Large Language Models, covering LLM concepts and practical techniques in Jupyter notebooks.
trymirai / uzu
Inference engine for running AI models locally inside apps, with Rust core and Swift, Python, and TypeScript bindings.
ashhart / TensorFold
Serves language models from a Zig binary on Apple Silicon and NVIDIA GPUs using Metal and CUDA kernels.
NVIDIA / Model-Optimizer
A library of model optimization techniques (quantization, pruning, distillation, NAS, speculative decoding, sparsity) that exports compressed checkpoints for inference frameworks.
anthropics / prompt-eng-interactive-tutorial
An interactive Jupyter notebook course teaching prompt engineering techniques for Anthropic's Claude models.
modular / modular
Open-source components of the Modular Platform, including the MAX AI framework and the Mojo programming language.
nyldn / claude-octopus
Claude Code plugin that runs the same research, design, or coding task across multiple external AI models and flags where they disagree.
NVIDIA-NeMo / Nemotron
Developer hub with training recipes, cookbooks, datasets, and end-to-end examples for building with NVIDIA's open Nemotron models.
PrismML-Eng / Bonsai-demo
Demo scripts for running PrismML's Bonsai 2 small LLMs (2B to 27B) locally on Mac, Linux, Windows, or CPU.
ZeroLu / awesome-seedance
A curated collection of prompts, video-generation techniques, and API guides for ByteDance's Seedance 2.0 AI video model.
crmne / ruby_llm
Ruby framework for building AI features with a unified API across 23 model providers, tools, agents, and Rails conventions.
modelcontextprotocol / java-sdk
Official Java SDK for building Model Context Protocol servers and clients, maintained with the Spring AI team.
zml / zml
A Zig inference framework that compiles ML models through MLIR and OpenXLA to run on NVIDIA, AMD, Intel, TPU, and Trainium hardware.
GoogleCloudPlatform / generative-ai
Sample notebooks, code, and apps demonstrating how to build with generative AI models on Google Cloud.
github / CopilotForXcode
GitHub Copilot plugin for Xcode providing code completions, chat, agent mode, and code review for Swift and Objective-C.
datawhalechina / happy-llm
A Chinese-language tutorial book that teaches LLM principles and walks through building and training a small LLaMA2-style model from scratch.