AI-assisted PCB design for KiCAD 10. Native KiCAD plugin — a single Rust binary exposing 217 schematic, layout, routing, placement, design-review, and manufacturing tools to Claude, or the LLM of your choosing
A high-performance inference engine for AI models
⚡ The fastest open-source AI gateway — one Rust binary with a built-in console to route, secure, budget and observe every LLM call across OpenAI, Anthropic, Gemini, Bedrock and more.
The open source AI coding agent, in Rust. CLI, TUI and HTTP server for local AI agents — no Docker required.
CLI proxy that reduces LLM token consumption by 60-90% on common dev commands. Single Rust binary, zero dependencies
an open source, extensible AI agent that goes beyond code suggestions - install, execute, edit, and test with any LLM
Jan is an open source alternative to ChatGPT that runs 100% offline on your computer.
The fastest, cheapest, most efficient open-source agent harness. Run more than 500 agents on a $10 VPS.
Hundreds of models & providers. One command to find what runs on your hardware.
YC (S26) | Open Computer History | Continuously record your company computer work, map your workflows, help you find work worth automating, and power your agents' context
High performance coding agent harness written in Rust, built for heavy multi-agent dev workflows
Incremental engine for long horizon agents 🌟 Star if you like it!
A super fast Graph Database uses GraphBLAS under the hood for its sparse adjacency matrix graph representation. Our goal is to provide the best Knowledge Graph for LLM (GraphRAG).
Astrid is a portable, capability-secure operating system for composable software.
The Open Runtime for AI Agents
The programming language for agents
⚙️🦀 Build modular and scalable LLM Applications in Rust
World's first open-source enterprise world model.
A Datacenter Scale Distributed Inference Serving Framework
Fast, flexible LLM inference
A CLI tool to convert your codebase into a single LLM prompt with source tree, prompt templating, and token counting.
AI enabled pair programmer for Claude, GPT, O Series, Grok, Deepseek, Gemini and 300+ models
Open Lakehouse Format for Multimodal AI. Convert from Parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, and PyTorch with more integrations coming..
Plano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails so you stay focused on your agents core logic.
An embeddable, portable, branchable virtual machine to safely run Agents locally.
⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.
A blazing fast inference solution for text embeddings models
Tiny, fast, Linux-compatible sandboxes. Powered by WebAssembly.
RuVector provides High Performance, Real-Time decisions and agent memory , Self-Learning Ai, Vector GNN DB built in Rust.
agent runtime security - zero trust, zero setup, zero latency agent sandboxing
Hold a key, speak, release — AI-polished text appears at your cursor in any app. Open-source voice input for macOS & Windows. (按住快捷键说话,松开即得润色后的文字)
LeanCTX is the Context Gateway for AI Systems. Select task-relevant context, apply supported controls, connect local knowledge and inspect recorded evidence. Open-source Engine: CLI, MCP, hooks and supported proxy paths.
Distributed AI/LLM for the people. Share compute privately or publicly to power your agents and chat.
Metal driver for NVIDIA GeForce cards on macOS Sequoia
Semantic version control => entity-level diffs, blame, and impact analysis on top of git. 28 languages via tree-sitter. Built for coding agents.
Switchyard lets LLM applications route traffic across models and providers while preserving native OpenAI and Anthropic API compatibility - enabling flexible model selection, benchmarking, and cost/performance optimization.
Manage ChatGPT, Codex CLI, and Claude Code accounts and track quota in one place. Use multi-model smart routing with priority and automatic failover. Install AI tools and deploy local LLMs in one click.
Manage multiple Claude Code, OpenCode agents from either TUI or Web for easy access on mobile. Also supports Mistral Vibe, Codex CLI, Gemini CLI, Pi.dev, Copilot CLI, Factory Droid Coding.
Add a real-time analytics node to your operational database. Spice is a portable, accelerated SQL query, search, and LLM-inference engine in Rust for data-grounded AI apps and agents.
Infinity is a high-throughput, low-latency serving engine for text-embeddings, reranking models, clip, clap and colpali
A secure persistent personal agent server in Rust. One binary, sandboxed execution, multi-provider LLMs, voice, memory, Telegram, WhatsApp, Discord, Teams, and MCP tools. Secure by design, runs on your hardware.
OpenLake is a high performance storage engine for efficient LLM inference and GPU Training
Open-source desktop AI agent for tools, files, knowledge, workflows, and real deliverables.
A git prepare-commit-msg hook for authoring commit messages with LLMs.
Bionic is sovereign Agentic AI for the enterprise — Runs on-premise and can securely work with your sensitive data and systems.
Fast, local-first web content extraction for LLMs. Scrape, crawl, extract structured data — all from Rust. CLI, REST API, and MCP server.
Instant, controllable, local pre-trained AI models in Rust
AI API 中转站评测排行与切换工具:实测可用率、延迟与价格 · Open-source AI API relay benchmark, rankings & switcher for Claude Code / Codex
🦭 A cross-device desktop AI agent with memory, autonomous goals, dynamic workflows, and headless deployment | 会记忆、能持续推进目标、会动态编排多 Agent 的跨端桌面 AI 助手,也可服务化常驻 NAS / 云端
Lightweight coding agent written in Rust, optimized for memory footprint and performance
Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.
NobodyWho is an inference engine that lets you run LLMs locally and efficiently on any device.
Get up and running with GLM-5.3-flash, DeepSeek, Gemma and other open source frontier models.
NeuroSploit is an advanced, AI-powered penetration testing framework designed to automate and augment various aspects of offensive security operations.
The agent framework where every run is durable, replayable, and resumable by default.
Run open decision models locally: pull and serve Laya, decider, NLI and GLiClass behind a TypeSafe-compatible API. Ollama for decision models.
🦜️🔗LangChain for Rust, the easiest way to write LLM-based programs in Rust
Entity-level git merge driver. Resolves false conflicts git invents when independent agents edit the same file. ~95% reduction vs. line-based merge.
1 place to call all your agents - OpenCode, Hermes, Claude Managed Agents, Cursor Agents API, DeepAgents.
Coordinate your coding agents like a group chat — read receipts, delivery tracking, and remote ops from your phone. One pip install, zero infrastructure. A production‑minded orchestrator for 24/7 workflow