Indras-Mirror / Xolotl

Xolotl (formerly Strata-DSV4.1): DeepSeek-V4.1-Flash, all 552B, on one gaming PC (RTX 4090 + 90 GB RAM) at ~27 tok/s, plus GLM-5.3-Flash, Qwen3.8-Flash-Next and Qwen3.8-27B. A heavily extended fork of Strata: MoE experts tiered across VRAM, pinned RAM and NVMe; OpenAI + Anthropic API.

NODIX-TECH / DLSS-5-MANAGER

THE FIRST DLSS 5 MANAGER

noonghunna / club-3090

Community recipes for serving LLMs on RTX 3090/4090/5090 CUDA gpus. Multi-engine (vLLM, sglang, llama.cpp and other custom engines) and model-agnostic. Currently shipping Qwen3.8-27B Qwen3.6 35B Gemma 4 26B Gemma 4 31B configs for 1×/2×/4x/8x cards.

sudoingX / local-ai-on-your-gaming-gpu

run a 27b local ai on your gaming gpu, rtx 3060 and up, radeon rx 6600 and up in beta, 8gb or more, linux and windows, one line to install

dexmal / realtime-vla

Running VLA at 30Hz frame rate and 480Hz trajectory frequency

speakrail / speakrail

Speakrail - a low-latency fully-local voice assistant that runs on a single RTX 4090

DominikBucko / qwen38-flash-next-2x3090

Qwen3.8-Flash-Next on 2× RTX 3090: with 128 GB RAM up to 4,191 tok/s prefill · 111.5 tok/s decode (131K prompt), full 256K window at 2,865 tok/s; with 64 GB RAM 3,410 tok/s prefill · 84 tok/s decode. New: opt-in uncensored mode (runtime abliteration, no new weights).

JGamboa / ninfer-4090-windows

—

alphastorm / omp-ninfer

Durable local inference for Oh My Pi: NInfer + Qwen3.8 27B on one RTX 3090/4090/5090, with restart-resumable OpenAI Responses state.

xilla420 / dlss5-wow-sidecar

DLSS 5 Neural Rendering for World of Warcraft (WoW) on NVIDIA RTX 40/50 — a safe overlay with no DLL injection, no hooks and no ReShade next to Wow.exe. Free and open source.

alanthinker / ninfer-4090-yarn

NInfer-4090: NInfer inference engine ported to RTX 4090 (sm_89) with YaRN support for Qwen3.8-27B

H-EmbodVis / TurboVLA

TurboVLA: Real-Time Vision-Language-Action Model at 32 Hz on an RTX 4090 with <1 GB VRAM