InternLM / lmdeploy

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

NVIDIA / cudnn-frontend

cuDNN Frontend is NVIDIA's modern, open-source entry point to the cuDNN library and a growing collection of high-performance open-source kernels.

dnv2003 / v100-skinny

Hand-written NVFP4 W4A16 CUDA kernels for Volta

yanght27 / GPU-Perf-Playground

GPU 性能与 AI Infra 学习项目：CUDA/Triton 算子、NCU/NSYS、vLLM/SGLang/TRT-LLM/ms-swift、PyTorch/DeepSpeed/ms-swift 训练、并行架构