A scalable, agentic-first, and HuggingFace-native RL framework for research (9k lines).
llama.cpp optimized for NVIDIA Tesla V100 (SM70): large MoE Qwen3.8-Flash-Next with MTP (prefill 3464 tok/s at 200K context, 6x V100-16GB) and Qwen3.8-27B with DFlash2 (decode up to 225 tok/s); 2-6 GPUs, 262K-512K context, multimodal, concurrent serving.
Switchless RoCE collectives, NCCL profiles and fabric tooling for DGX Spark inference recipes