📈 GH Trending Explorer 🎲 Surprise me

Search: gpu-inference · clear

brontoguana / krasis

Krasis is a Hybrid LLM runtime which focuses on efficient running of larger models on consumer grade VRAM limited hardware

★ 522 C++ 1d ago
infercrane / infercrane

Open-source infrastructure for the full inference lifecycle: deploy, observe, scale, optimize, and safely release self-hosted models behind one endpoint.

★ 54 Go 2d ago
buqi-code / buqi-minimax-h3-multigpu

MiniMax-H3 multi-GPU parallel inference for ComfyUI | 多卡并行加速节点:2-8 GPU Ulysses sequence parallel, bit-identical video+audio generation