AlexsJones / llmfit
Hundreds of models & providers. One command to find what runs on your hardware.
AlexsJones / llmfit
higress-group / HiRoute
Make Codex and Claude Code subscriptions go further: a local model router that gives routine agent work to economical models and keeps your strongest model for the hard parts.
NVIDIA / cuda-rust
NVIDIA's CUDA platform for Rust. Host runtime crates plus Tile (cutile-rs) and SIMT (cuda-oxide) kernel programming models in idiomatic Rust.
NVIDIA-NeMo / Switchyard
Switchyard lets LLM applications route traffic across models and providers while preserving native OpenAI and Anthropic API compatibility - enabling flexible model selection, benchmarking, and cost/performance optimization.
openinterpreter / openinterpreter
A coding agent for open models like Kimi K3 and GLM 5.3
ollaya-dev / ollaya
Run open decision models locally: pull and serve Laya, decider, NLI and GLiClass behind a TypeSafe-compatible API. Ollama for decision models.
pegainfer-project / kern
A model-agnostic GPU runtime for shipping models as verified programs.
midagedev / bloomery
Hybrid GPU + CPU inference for mixture-of-experts models, written in Rust down to the CUDA kernels. A drop-in llama-server.
Stremio / stremio-core
⚛️ The Stremio Core: types, addon system, UI models, core logic
google / magika
Fast and accurate AI powered file content types detection
hongfaqiu / strata-manager
Strata Manager makes Niko1221/Strata, the local LLM inference engine, easier to set up and use. Manage local models and services, monitor hardware and API usage, chat and tune inference. Open-source desktop app for Windows / Linux x64.
pykeio / ort
Fast ML inference & training for ONNX models in Rust
Headmaster218 / MoE4All
Run MoE models beyond VRAM on AMD, NVIDIA & Intel GPUs. Vulkan-powered, portable Windows app with automatic setup. | 让游戏显卡跑起超显存大模型，支持 AMD、NVIDIA、Intel，免安装、自动配置。只需13MB，即下即用！
ampersandru / VectorDash
Local, full Windows search replacement, clipboard manager, and launcher: files, apps, settings and semantic media search with Google's EmbeddingGemma 2.
michaelfeil / infinity
Infinity is a high-throughput, low-latency serving engine for text-embeddings, reranking models, clip, clap and colpali
RunanywhereAI / wally
Get up and running with GLM-5.3-flash, DeepSeek, Gemma and other open source frontier models.
shinkuan / Akagi
支持雀魂、天鳳、麻雀一番街、天月麻將，能夠使用自定義的AI模型實時分析對局並給出建議，內建Mortal AI作為示例。 Supports Majsoul, Tenhou, Riichi City, Amatsuki, with the ability to use custom AI models to analyze games in real time and provide suggestions. Comes with Mortal AI as a built-in example.
xuzhougeng / wisp-science
Open-source, local-first desktop AI research workbench for scientific computing with Python/R, MCP bioinformatics tools, SSH/WSL/GPU runtimes, and OpenAI/Anthropic models.
smartcorelib / smartcore
A comprehensive library for machine learning and numerical computing. Apply Machine Learning with Rust leveraging first principles.
zavora-ai / adk-rust
Rust Agent Development Kit (ADK-Rust): Build AI agents in Rust with modular components for models, tools, memory, realtime voice, and more. ADK-Rust is a flexible framework for developing AI agents with simplicity and power. Model-agnostic, deployment-agnostic, optimized for frontier AI models. Includes support for real-time voice agents.
llmmanorg / llmman
Run any agent on any model, models stored as OCI images
truespar / paddock
Native Rust inference server for open models on NVIDIA and Apple Silicon. OpenAI- and Anthropic-compatible APIs, GGUF + safetensors + MLX, FP8/NVFP4/MXFP4/Q8/Q4, built-in Studio
InferMatrixLab / system1-omni
community maintained vllm/vllm-omni style inference engine for system1 models in Rust for extreme efficient performance
Michael-A-Kuykendall / shimmy
⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.
huggingface / text-embeddings-inference
A blazing fast inference solution for text embeddings models
StarlightSearch / EmbedAnything
Highly Performant, Modular, Memory Safe and Production-ready Inference, Ingestion and Indexing built in Rust 🦀
antiburn / antiburn
Fast, free local checks to reduce your token burn. Helps you avoid limits by checking for: sessions too deep, models too powerful, caching broken, unused tools/MCPs/skills, and many more.
crabbuild / crab
Serverless Git for large files: store models, datasets, and assets in your own S3, GCS, Azure, or S3-compatible bucket.
nylon-memory / NylonME
A Memory Engine for AI Agents,Working with Jev can bring higher decision accuracy . Nylon models a memory as a woven body of multiple strands of "threads" (facts/emotions/timing/relationships/beliefs/frequencies), with weighted edges between memory nodes forming a network graph rather than a hierarchical tree.
Fast-Editor / OpenCode-Wrap
Using OpenCode free models for personal Use
skytable / skytable
Skytable is a modern scalable NoSQL database with BlueQL, designed for performance, scalability and flexibility. Skytable gives you spaces, models, data types, complex collections and more to build powerful experiences
zurawiki / gptcommit
A git prepare-commit-msg hook for authoring commit messages with LLMs.
floneum / kalosm
Instant, controllable, local pre-trained AI models in Rust
apache / casbin-rs
An authorization library that supports access control models like ACL, RBAC, ABAC in Rust
NucleoidAI / Nucleoid
Synthesized Logic Language for World Models 🌱🐋🌍
t8 / hypura
Run models too big for your Mac's memory
DSchroer / dslcad
DSLCad is a programming language & interpreter for building 3D models.
reyamira / models
TUI and CLI for browsing models.dev, benchmarks, coding agents, and statuses for AI providers.
alvarobartt / sys1
Blazing fast, self-hosted structured decisions for open models with a TypeSafe AI compatible API, written in Rust.
ewsun22 / codex-manager
Local-first desktop control center for OpenAI Codex — sessions, models, tokens, accounts, providers, and AGENTS.md.
npci / ainxt-cli
AiNxt CLI is an open-source AI coding agent that brings AI-powered software development directly to the terminal. It can understand code, build features, fix issues, automate tasks and execute commands using the AI models and providers chosen by the developer.
npci / ainxt-os
AiNxt OS is an open foundation for building and running AI applications and agents. It provides the core building blocks for connecting AI models, tools and workflows, giving developers the flexibility to build AI solutions using the technologies and models they choose.
QuipNetwork / quip-solver
The quip network mining stack. This includes a coordinator and links all of the official quip network miners.
tailcallhq / forgecode
AI enabled pair programmer for Claude, GPT, O Series, Grok, Deepseek, Gemini and 300+ models
tdaylan / NoiseScope
A control instrument for handshake state machines - lint protocol models, replay transcripts, and fly deterministic mutations until a trace diverges.