deepseek-ai / FlashMLA

Optimized GPU and NPU attention kernels from DeepSeek for sparse prefill and FP8/FP4 KV-cache decoding in DeepSeek-V4.1 inference.

NVIDIA / Model-Optimizer

A library of model optimization techniques (quantization, pruning, distillation, NAS, speculative decoding, sparsity) that exports compressed checkpoints for inference frameworks.

NVIDIA / nccl

NVIDIA's C++/CUDA library of optimized collective communication primitives (all-reduce, all-gather, broadcast, etc.) for multi-GPU and multi-node systems.

Vectorized / solady

Gas-optimized Solidity snippets and contract libraries for Ethereum, including ERC20, ERC721, and ERC1155 implementations.

transmissions11 / solmate

Gas-optimized Solidity building blocks for smart contract development, including tokens, auth, math, and utility contracts.