Indras-Mirror / Xolotl

Xolotl (formerly Strata-DSV4.1): DeepSeek-V4.1-Flash, all 552B, on one gaming PC (RTX 4090 + 90 GB RAM) at ~27 tok/s, plus GLM-5.3-Flash, Qwen3.8-Flash-Next and Qwen3.8-27B. A heavily extended fork of Strata: MoE experts tiered across VRAM, pinned RAM and NVMe; OpenAI + Anthropic API.

MakazhanAlpamys / Soup

Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.

T-Crypt / berth

Decides who gets your GPU. Chat, image and voice engines lease the card in turn instead of grabbing it, so two of them never load at once and crash each other. One Go binary, nothing else to install.

FlashML-org / FreeVideo

Make videos on the computer you already own. FreeVideo runs MiniMax H3 in as little as 8 GB of VRAM and 16 GB of RAM, and adapts its acceleration path to your hardware.

harry7557558 / spirula-studio

Desktop and CLI tool that trains 3D Gaussian Splatting models from photos or video, then exports splats and textured meshes, using Vulkan compute.

CSUNX233 / qwen3.8-27b-ninfer-5070tilaptop-kvmem-local-agent

RTX 5070 Ti Laptop 12GB 跑 Qwen3.8-27B：NInfer + KVMem、256K 逻辑上下文、RAM KV、MTP、快速缓存续接与 dsh 本地 Agent / 搜索 / 浏览器。含源码、Windows 部署及实测。

Jit-Roy / WeeLLM

WeeLLM runs large diffusion models with as little as 4 GB of VRAM, without any quantization. It dynamically determines how many layers can fit within the available VRAM and streams the text encoder and transformer layers to the GPU layer by layer, enabling inference on hardware with limited VRAM. It supports both safetensors and GGUF models.

Headmaster218 / MoE4All

Run MoE models beyond VRAM on AMD, NVIDIA & Intel GPUs. Vulkan-powered, portable Windows app with automatic setup. | 让游戏显卡跑起超显存大模型，支持 AMD、NVIDIA、Intel，免安装、自动配置。只需13MB，即下即用！

star7code / minimax-h3-chunk-star7

VRAM-efficient MiniMax H3 for ComfyUI: QKV/RoPE/MLP activation chunking, automatic OOM chunk reduction, and CK/SLA/Sol/Hybrid attention for SM75 and SM80+ GPUs.

Thefrizzy1 / The_frizzy1-Workflows

Verified, organised docs for every The_frizzy1 low-VRAM ComfyUI workflow - GGUF image/video/audio from 4GB VRAM.

volotat / mini-AGI

Continual learning model trained from scratch on 8GB VRAM laptop with batch-1 stream of data.

DaoyuanLi2816 / can-i-finetune-this

Single-GPU LLM fine-tuning preflight: memory estimates, runnable LoRA/QLoRA recipes, and local measurements.

H-EmbodVis / TurboVLA

TurboVLA: Real-Time Vision-Language-Action Model at 32 Hz on an RTX 4090 with <1 GB VRAM

xmarre / ComfyUI-Spectrum-MiniMax-H3

Training-free Spectrum acceleration for ComfyUI’s native MiniMax H3 audio-video model. Uses Chebyshev ridge feature forecasting to skip selected H3 transformer evaluations, with adaptive scheduling, sampler-aware support for Euler, ER-SDE, RES, SEEDS and SA-Solver, CPU/VRAM history storage, and fail-closed native fallbacks.

andreiavrammsd / cpp-channel

C++11 thread-safe container for sharing data between threads (synchronized queue)

brontoguana / krasis

Krasis is a Hybrid LLM runtime which focuses on efficient running of larger models on consumer grade VRAM limited hardware

baselkelziye / YTU_Bilgisayar_Muhendisligi_Arsiv

Yıldız Teknik Üniversitesi Bilgisayar Mühendisliği Bölüme Lisans ve Yüksek Lisansa Dair Genel Bilgiler, Ders Notları, Ders slaytları, Örnek Proje. Burada Staj, Erasmus, Yaz Okulu, KOOP gibi Kavramların Süreçlerini ve Detaylarını bulabilirsiniz.

vizart-vj / ComfyUI-MiniMax-H3-LongMedia

ComfyUI custom nodes for MiniMax H3 long-form video/audio generation with streamed Sol attention, compressed KV, adaptive VRAM guards, chunked MLP/final output, and SAFE long-sequence optimizations for limited VRAM.

bbaudio-2025 / Comfyui-MMH3-UltimateUpscale

Upscale long, high-resolution MiniMax H3 video on a VRAM-limited GPU in a single node.

Saganaki22 / ComfyUI-sol-attn

NVIDIA Sol-Attn for ComfyUI / Triton kernel on SM89 - SM121, with zero-copy MiniMax H3 nodes: memory-efficient attention, scheduled tau with graph preview, and feed-forward chunking. Measured 1.14–1.44× vs SageAttention and −37% MLP peak VRAM on H3

AcademiaSD / AcademiaSD_LoRAlab-Krea2

Low-VRAM LoRA Training for Krea-2

sybil-solutions / dsv41-flash-offload

DeepSeek-V4.1-Flash EXL3 on one 24 GB RTX 3090 + DDR4 + NVMe: staged-DMA prefill, AVX2 CPU expert tier, elastic VRAM expert cache, Engram on disk, OpenAI API

yalun753 / moe-l2

MoE expert offload for low-VRAM GPUs — run 100B+ MoE models (DeepSeek, Qwen, Mixtral) on 8 GB cards. Expert cache with LRU hot experts, OpenAI-compatible proxy, GGUF multi-shard.

hradec / ComfyUI-HR-Endless-Sampler

Chunked video/audio sampling for ComfyUI with latent continuation, frame-accurate shot prompt rewriting, and reduced VRAM usage.

AcademiaSD / AcademiaSD_LoRAlab-TrainerStudio

Train LoRAs for Qwen-Image 2.1, FLUX.2 Klein 9B, FLUX.3 Image Klein, Krea 2, Z-Image, MOSS-Image, ERNIE-Image, Ideogram 4, Anima, SDXL (Pony, Illustrious, NoobAI), LTX 2.3, MiniMax-H3, and more on NVIDIA GPUs from 4–8 GB VRAM. One install, one launcher, NF4 models. Windows, Linux and RunPod.

Saganaki22 / ComfyUI-Breeze-TTS-2

Breeze TTS 2 nodes for ComfyUI: voice clone, voice design, and voice direction with bilingual (EN/ZH) speech, inline vocal events, INT8 ConvRot quantized builds, and full ComfyUI / AIMDO dynamic-VRAM integration.

mehmetbulutaktas458-dev / Aozora-Forge

Low VRAM SDXL Fine-Tuning Toolkit 2026: Train Full-Quality AI Models on 12GB GPUs

KingHsp / vram-sage-training

The 2026 VRAM-Smart Fine-Tuning Suite for SDXL and ANIMA on 12GB GPUs

Apolog1ze-Dev / QwFNfer

A custom inference engine tuned for Qwen4 architecture. Currently runs Qwen3.8-Flash-Next at 15+ tok/s on 16GB of VRAM and 30 GB of RAM

lololerigolo60 / Prompt-architect

Prompt Architect Pro is a Python desktop app that uses local Ollama LLMs to analyze raw texts and images. It extracts and structures visual descriptions into optimized JSON prompts for generative AI. It features a built-in SQLite database for prompt editing and adjustable VRAM hardware profiles. with a ComfyUI node that can use the database

dirtymalonepost-cmd / Vram-Management-fix

a workaround to fix the stutters and constant memory evacuation caused by dmemcg-booster (VRAM Management), leveraging most of the intended performance improvement.

sepiablue-ai / ComfyUI-H3-X2-Stream

ComfyUI nodes for MiniMax H3: INT8 X2 VAE and asynchronous NVENC saving. 5-second 1088x1920 video with audio in about 60 s on an RTX 4070 12GB, about 30% faster than the FP16 X2 VAE.

ExVRAM / exvram-lab

Compute-for-memory research lab for running larger LLMs on memory-constrained consumer GPUs. Official website exvram.pro

kadenball / qwen38-27b-rtx3060-dcfr

RouteWeaver: experimental cache-safe speculative inference and CPU/GPU transfer optimization for Qwen 27B on low-VRAM NVIDIA GPUs.

mark9009 / ComfyUI-H3-LongTake

Long MiniMax H3 videos clip by clip with continuity: motion/identity transfer and style transfer/retexture, resumable, one clip in VRAM at a time

miltos22 / llama-wackMall

Caching experts made model agnostic for llama. Drastically speeds up generation speed on MoE models that fully fit in the RAM but partially in Vram. WIP: Same speedup but for models that don't fit in the ram either.

sepiablue-ai / minimax_h3_workflows

ComfyUI workflows for MiniMax H3 (Ref2VA / FL2VA / VideoRef / Pose Control) at Full HD on 12GB VRAM.

1314521gjy / cyber-on-strata

在 8 GB 显存的显卡上跑 35B MoE（Cyber-Tiel-Coder-35B-A3B）：专家权重流式上卡、未命中专家由 CPU 池就地计算。Strata 引擎的 fork（MIT）。RTX 4080S 实测 8 GB 档 57.7–63.5 tok/s、全常驻 134–136 tok/s。Build from THIS repo — upstream does not support this model.

Vkuparin / gamepause-for-local-ai

GamePause for Local AI: a Windows tray app that pauses LM Studio, Ollama and other local AI servers while you game, and restores them afterward.