trycua / cua
Desktop platform giving AI agents full macOS and Linux desktops in local VMs or your own cloud, with drivers, models, and benchmarks.
trycua / cua
trymirai / uzu
Inference engine for running AI models locally inside apps, with Rust core and Swift, Python, and TypeScript bindings.
AlexsJones / llmfit
Hundreds of models & providers. One command to find what runs on your hardware.
pegainfer-project / kern
A model-agnostic GPU runtime for shipping models as verified programs.
midagedev / bloomery
Hybrid GPU + CPU inference for mixture-of-experts models, written in Rust down to the CUDA kernels. A drop-in llama-server.
openinterpreter / openinterpreter
A coding agent for open models like Kimi K3 and GLM 5.3
NVIDIA / cuda-rust
NVIDIA's CUDA platform for Rust. Host runtime crates plus Tile (cutile-rs) and SIMT (cuda-oxide) kernel programming models in idiomatic Rust.
hongfaqiu / strata-manager
Strata Manager makes Niko1221/Strata, the local LLM inference engine, easier to set up and use. Manage local models and services, monitor hardware and API usage, chat and tune inference. Open-source desktop app for Windows / Linux x64.
higress-group / HiRoute
Make Codex and Claude Code subscriptions go further: a local model router that gives routine agent work to economical models and keeps your strongest model for the hard parts.
tailcallhq / forgecode
AI enabled pair programmer for Claude, GPT, O Series, Grok, Deepseek, Gemini and 300+ models
Stremio / stremio-core
⚛️ The Stremio Core: types, addon system, UI models, core logic
ampersandru / VectorDash
Local, full Windows search replacement, clipboard manager, and launcher: files, apps, settings and semantic media search with Google's EmbeddingGemma 2.
google / magika
Fast and accurate AI powered file content types detection
NVIDIA-NeMo / Switchyard
Switchyard lets LLM applications route traffic across models and providers while preserving native OpenAI and Anthropic API compatibility - enabling flexible model selection, benchmarking, and cost/performance optimization.
pykeio / ort
Fast ML inference & training for ONNX models in Rust
RunanywhereAI / wally
Get up and running with GLM-5.3-flash, DeepSeek, Gemma and other open source frontier models.
smartcorelib / smartcore
A comprehensive library for machine learning and numerical computing. Apply Machine Learning with Rust leveraging first principles.
llmmanorg / llmman
Run any agent on any model, models stored as OCI images
Headmaster218 / MoE4All
Run MoE models beyond VRAM on AMD, NVIDIA & Intel GPUs. Vulkan-powered, portable Windows app with automatic setup. | 让游戏显卡跑起超显存大模型，支持 AMD、NVIDIA、Intel，免安装、自动配置。只需13MB，即下即用！
antiburn / antiburn
Fast, free local checks to reduce your token burn. Helps you avoid limits by checking for: sessions too deep, models too powerful, caching broken, unused tools/MCPs/skills, and many more.
crabbuild / crab
Serverless Git for large files: store models, datasets, and assets in your own S3, GCS, Azure, or S3-compatible bucket.
truespar / paddock
Native Rust inference server for open models on NVIDIA and Apple Silicon. OpenAI- and Anthropic-compatible APIs, GGUF + safetensors + MLX, FP8/NVFP4/MXFP4/Q8/Q4, built-in Studio
QuipNetwork / quip-solver
The quip network mining stack. This includes a coordinator and links all of the official quip network miners.
huggingface / text-embeddings-inference
A blazing fast inference solution for text embeddings models
michaelfeil / infinity
Infinity is a high-throughput, low-latency serving engine for text-embeddings, reranking models, clip, clap and colpali
skytable / skytable
Skytable is a modern scalable NoSQL database with BlueQL, designed for performance, scalability and flexibility. Skytable gives you spaces, models, data types, complex collections and more to build powerful experiences
zurawiki / gptcommit
A git prepare-commit-msg hook for authoring commit messages with LLMs.
floneum / kalosm
Instant, controllable, local pre-trained AI models in Rust
ollaya-dev / ollaya
Run open decision models locally: pull and serve Laya, decider, NLI and GLiClass behind a TypeSafe-compatible API. Ollama for decision models.
StarlightSearch / EmbedAnything
Highly Performant, Modular, Memory Safe and Production-ready Inference, Ingestion and Indexing built in Rust 🦀
apache / casbin-rs
An authorization library that supports access control models like ACL, RBAC, ABAC in Rust
shinkuan / Akagi
支持雀魂、天鳳、麻雀一番街、天月麻將，能夠使用自定義的AI模型實時分析對局並給出建議，內建Mortal AI作為示例。 Supports Majsoul, Tenhou, Riichi City, Amatsuki, with the ability to use custom AI models to analyze games in real time and provide suggestions. Comes with Mortal AI as a built-in example.
xuzhougeng / wisp-science
Open-source, local-first desktop AI research workbench for scientific computing with Python/R, MCP bioinformatics tools, SSH/WSL/GPU runtimes, and OpenAI/Anthropic models.
NucleoidAI / Nucleoid
Synthesized Logic Language for World Models 🌱🐋🌍
zavora-ai / adk-rust
Rust Agent Development Kit (ADK-Rust): Build AI agents in Rust with modular components for models, tools, memory, realtime voice, and more. ADK-Rust is a flexible framework for developing AI agents with simplicity and power. Model-agnostic, deployment-agnostic, optimized for frontier AI models. Includes support for real-time voice agents.
t8 / hypura
Run models too big for your Mac's memory
DSchroer / dslcad
DSLCad is a programming language & interpreter for building 3D models.
reyamira / models
TUI and CLI for browsing models.dev, benchmarks, coding agents, and statuses for AI providers.
alvarobartt / sys1
Blazing fast, self-hosted structured decisions for open models with a TypeSafe AI compatible API, written in Rust.
nylon-memory / NylonME
A Memory Engine for AI Agents,Working with Jev can bring higher decision accuracy . Nylon models a memory as a woven body of multiple strands of "threads" (facts/emotions/timing/relationships/beliefs/frequencies), with weighted edges between memory nodes forming a network graph rather than a hierarchical tree.
ewsun22 / codex-manager
Local-first desktop control center for OpenAI Codex — sessions, models, tokens, accounts, providers, and AGENTS.md.
npci / ainxt-cli
AiNxt CLI is an open-source AI coding agent that brings AI-powered software development directly to the terminal. It can understand code, build features, fix issues, automate tasks and execute commands using the AI models and providers chosen by the developer.
npci / ainxt-os
AiNxt OS is an open foundation for building and running AI applications and agents. It provides the core building blocks for connecting AI models, tools and workflows, giving developers the flexibility to build AI solutions using the technologies and models they choose.
Fast-Editor / OpenCode-Wrap
Using OpenCode free models for personal Use
Michael-A-Kuykendall / shimmy
⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.
tdaylan / NoiseScope
A control instrument for handshake state machines - lint protocol models, replay transcripts, and fly deterministic mutations until a trace diverges.