lightseekorg / tokenspeed

TokenSpeed is a speed-of-light LLM inference engine.

meta-pytorch / dist_moe

Dist-MoE implements Speed-of-Light distributed Mixture-of-Experts forward and backward kernels. They are highly optimized and fused comm-compute kernels for training and inference on SM100+ GPUs

SJTU-DENG-Lab / WaveForcing

Wave Forcing: Towards Speed-of-Light Streaming Video Generation