meta-pytorch / dist_moe

Dist-MoE implements Speed-of-Light distributed Mixture-of-Experts forward and backward kernels. They are highly optimized and fused comm-compute kernels for training and inference on SM100+ GPUs

crit-labs / crit

Why wait for someone to optimize an LLM for your GPU when an AI agent can build a specialized inference engine in a few hours?