llm-d / llm-d
State of the art inference performance with modern accelerators on Kubernetes
llm-d / llm-d
sgl-project / sglang-omni
High Performance Serving Runtime For Interactive Super Intelligence System
flashinfer-ai / flashinfer
FlashInfer: Kernel Library for LLM Serving
gpustack / gpustack
A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.
Nehanth / pooled
Peer-to-peer LLM inference in the browser: pool your devices to run big open models, for chat and coding agents.
JustVugg / lumabri
Run large AI models across your computers and servers. Powered by Colibri. Pure C.
trademav / ramdeck-core-public
Pool RAM across old PCs, Macs, and Android devices into a unified local AI cluster
christopherowen / dgx-spark-networking
Switchless RoCE collectives, NCCL profiles and fabric tooling for DGX Spark inference recipes
buqi-code / buqi-minimax-h3-multigpu
MiniMax-H3 multi-GPU parallel inference for ComfyUI | ε€ε‘εΉΆθ‘ε ιθηΉ:2-8 GPU Ulysses sequence parallel, bit-identical video+audio generation
Deen-Media / dgx-monarch
Distributed image and video generation in ComfyUI for two NVIDIA DGX Sparks.
christopherowen / spark-ds41f
Reproducible Docker/vLLM deployment, tuning, and benchmarks for DeepSeek V4.1 Flash on a switchless three-node DGX Spark fabric.