tile-ai / tilelang

A Python-embedded domain-specific language and TVM-based compiler for writing high-performance GPU, CPU, and NPU kernels.

deepseek-ai / TileKernels

A kernel library written in tilelang

NX-AI / KronLSTM

Flash-linear-attention compatible KronLSTM model and kernels by NXAI.

Gxj230958 / TritonAscendBench

A migration benchmark that measures whether production GPU Triton kernels — extracted from vLLM and SGLang inference paths — can be ported to the Huawei Ascend 910B (Atlas A2) via `triton-ascend` without losing correctness or performance.

tenstorrent / tt-metal

:metal: TT-NN operator library, and TT-Metalium low level kernel programming model.

NVlabs / kda

Kernel Design Agents (KDA) is a agent-centric workflow to write high-performance CUDA Kernels.

lithos-ai / lithos-metal

lithos-metal: high-performance LLM inference kernels and serving for Apple silicon.

InternLM / lmdeploy

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

NVIDIA / cutile-python

cuTile is a programming model for writing parallel kernels for NVIDIA GPUs

NVIDIA / cudnn-frontend

cuDNN Frontend is NVIDIA's modern, open-source entry point to the cuDNN library and a growing collection of high-performance open-source kernels.

huggingface / kernels

Build compute kernels and load them from the Hub.

inclusionAI / cuLA

CUDA kernels for linear attention variants, written in CuTe DSL and CUTLASS C++.

morluto / flameox

Runtime evidence that helps agents trace, profile, and burn down hotspots in application and native code, GPU kernels, and inference stacks.

mlc-ai / TIRx-kernels

Curated high-performance TIRx GPU kernels

PKU-DAIR / PipeLink

A linker for partial GPU kernels.

flagos-ai / FlagGems

FlagGems is an operator library for large language models implemented in the Triton Language.

CrossGL / crosstl

Translate GPU shaders and compute kernels between Metal, HLSL and GLSL, and to SPIR-V and WGSL, through the CrossGL IR

arighi / virtme-ng

Quickly build and run kernels inside a virtualized snapshot of your live system

zengxiao-he / tessera

From teacher to tiles — a from-scratch LLM distillation & serving engine: custom Triton/CUDA kernels, FSDP distillation, paged-KV continuous batching, speculative decoding, a Rust gateway, a JAX oracle, and interpretability tooling.

dnv2003 / v100-skinny

Hand-written NVFP4 W4A16 CUDA kernels for Volta

Inferact / tpu-megakernels

A collection of megakernels for TPU

Oruk-AI / orukeet

Orukeet: multilingual ASR with fitted, frozen Gabor kernels and native inference

matsuzaka-yuki / susfs-lkm-module

KernelSU-compatible ZIP wrapper for pinned inforcqb SUSFS LKM; loader only, no rule management

yanght27 / GPU-Perf-Playground

GPU 性能与 AI Infra 学习项目：CUDA/Triton 算子、NCU/NSYS、vLLM/SGLang/TRT-LLM/ms-swift、PyTorch/DeepSpeed/ms-swift 训练、并行架构

julianmb / halofpx

High-performance Lemonade alternative for AMD Strix Halo & Radeon — latest MoE models (Ling-3.0-Flash, Qwen 3.8 Flash Next, Ornith 1.5), bleeding-edge RDNA 3.5 Wave64/ROCmFP4 kernels, and silicon-tuned profiles.

joshuaswarren / metal2vk

Compile Metal Shading Language compute kernels to Vulkan SPIR-V (clang C++ for OpenCL + a metal_stdlib shim + clspv)

arpanpathak / gpu-parallel-book

📖 GPU parallel programming from the ground up : CUDA C++ and Rust 🦀 kernels paired with clickable SVG 2D/3D architecture diagrams (warps, SMs, memory tiers). Includes reduction, scan, matmul, and a full image‑processing capstone

sudoingX / dgx-spark-deepseek-v41

DeepSeek-V4.1-Flash on two NVIDIA DGX Sparks: EXL3 weights from the official checkpoint, upstream vLLM with our patches and decode kernels

RightNow-AI / local-kimi

Optimized local serving engine for Kimi-Linear-48B: INT4 quantizer, fused decode kernels for a measured 3.18x, and an OpenAI-compatible server. Ships with k3, a bridge that detects the client per request so Claude Code, Codex, Cline, Aider and opencode all work unchanged.

krishna3163 / best-root-apps-for-android

Curated directory of Android root apps, Magisk, KernelSU, LSPosed modules, system tools, privacy utilities, and no-root Shizuku apps.

bertaye / agentic-cuda-optimizer

A langgraph based workflow with a C++ CUDA harness to optimize CUDA kernels

drowzeys / keys-SM121-Optimized-MiniMax-H3-Nvidia-Sol-Engine-Kijai-SolAttn_Triton-Single-DGX-Spark

MiniMax-H3 33B audio+video DiT accelerated 1.54x on a single NVIDIA DGX Spark (GB10, sm_121): NVIDIA Sol-Engine FirstBlockCache + batched VAE decode ported to single-GPU ComfyUI, Sol-Attn patched for compute 12.1, kijai Triton INT8/TMA kernels. Benchmarks, charts, one-shot installer, agent recipe.

b3s3da / qemu-harness

QEMU harness for AI agents: boot aarch64/arm/riscv64/x86_64 kernels in seconds, exec via guest agent, fast rootfs rebuilds, IoT emulation

drowzeys / keys-Mac-TensorFold-MiniMax-H3-MLX

MiniMax H3 (video + audio) on TensorFold 0.6.5 with an H3 family, Mac Studio M5 Ultra: 5 s 864x480 clip in ~50 s, 40 s at 768x448 — the fastest H3 we have measured on Apple Silicon; int8 tensor-unit kernels + Turbo adapter; one-shot + GHCR carrier

awemorris / linux-pc98

Linux/pc98: Linux for NEC PC-9800 series, integrated repository of kernels, toolchains, and Debian/pc98 port

linkedin / Liger-Kernel

Efficient Triton Kernels for LLM Training

Dao-AILab / quack

A Quirky Assortment of CuTe Kernels

pytorch / helion

A Python-embedded DSL that makes it easy to write fast, scalable ML kernels with minimal boilerplate.

meta-pytorch / dist_moe

Dist-MoE implements Speed-of-Light distributed Mixture-of-Experts forward and backward kernels. They are highly optimized and fused comm-compute kernels for training and inference on SM100+ GPUs