janhq / jan

Jan is an open source alternative to ChatGPT that runs 100% offline on your computer.

slint-ui / slint

Slint is an open-source declarative GUI toolkit to build native user interfaces for Rust, C++, JavaScript, or Python apps.

bee-san / Ciphey

⚡ Automatically decrypt encryptions without knowing the key or cipher, decode encodings, and crack hashes ⚡

rerun-io / rerun

Visualize, query, and stream to train on multimodal robotics data.

fschutt / azul

Desktop GUI Framework

Michael-A-Kuykendall / shimmy

⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.

extism / extism

The framework for building with WebAssembly (wasm). Easily & securely load wasm modules, move data, call functions, and build extensible apps.

sfu-db / connector-x

Fastest library to load data from DB to DataFrames in Rust and Python

floneum / kalosm

Instant, controllable, local pre-trained AI models in Rust

intentee / paddler

Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.

peteonrails / voxtype

Voice-to-text with push-to-talk for Wayland compositors

foxglove / mcap

MCAP is a modular, performant, and serialization-agnostic container file format, useful for pub/sub and robotics applications.

microscope-dev / microscope

🔬 microscope 🔬

metasequoiaime / msime

下一代跨平台水杉输入法（MSIME）：面向 Android、iOS、macOS、Linux、Windows 与 HarmonyOS 的多平台中文输入法，使用共享输入引擎与各平台原生宿主。

huggingface / llm-ls

LSP server leveraging LLMs for code completion (and more?)

Dushistov / flapigen-rs

Tool for connecting programs or libraries written in Rust with other languages

utilityai / llama-cpp-rs

—

llmmanorg / llmman

Run any agent on any model, models stored as OCI images

lucasjinreal / Crane

A Pure Rust based LLM, VLM, VLA, TTS, OCR Inference Engine, powering by Candle & Rust. Alternate to your llama.cpp but much more simpler and cleaner..

hardrave / NIGHTRUN

Boot your PC straight into an LLM. Rust, UEFI-resident, no operating system underneath.

GabrieleLozupone / kokon

Edit photos by describing the change, on your own GPU. One installer, no Python, no cloud. Qwen-Image 2.1 for Windows and Mac, with an MCP server for AI agents.

DingoOz / llm-visuals

Live truecolor terminal dashboard for a locally running LLM: tok/s, TTFT, GPUs, context, MTP acceptance, layer and real expert routing (llama.cpp)

maximpri / mlxtop

A top for local LLMs: memory, paging, GPU and tokens/s for oMLX, Ollama, llama.cpp, vLLM and more

antonellof / frink

Pure-Rust GGUF inference engine with quantized CPU, Metal & CUDA kernels, MoE support, OpenAI-compatible server. Benchmarked head-to-head against llama.cpp.

midagedev / bloomery

Hybrid GPU + CPU inference for mixture-of-experts models, written in Rust down to the CUDA kernels. A drop-in llama-server.

Vkuparin / gamepause-for-local-ai

GamePause for Local AI: a Windows tray app that pauses LM Studio, Ollama and other local AI servers while you game, and restores them afterward.