JMS1717 / ming-voice

Low-latency local speech-to-speech voice assistant with Ming-3.0-audio-tiny on AMD and Nvidia GPUs. Easy setup on Windows and Linux

triton-lang / triton

Development repository for the Triton language and compiler

Gxj230958 / TritonAscendBench

A migration benchmark that measures whether production GPU Triton kernels — extracted from vLLM and SGLang inference paths — can be ported to the Huawei Ascend 910B (Atlas A2) via `triton-ascend` without losing correctness or performance.

triton-inference-server / server

The Triton Inference Server provides an optimized cloud and edge inferencing solution.

datawhalechina / llm-algo-leetcode

LLM algorithm practice lab with theory, solutions, and test cases.《大模型算法与系统教程》面向大模型入门到进阶的算法实战教程，覆盖原理讲解、答案解析、测试用例与 CUDA/Triton 实战。

AlibabaResearch / SparkDiffusion

SparkDiffusion: Accelerating DiT video generation by 265× via joint Sparsity, Distillation, Quantization, etc.

Exorust / TorchLeet

LeetCode for PyTorch — 65 ML/AI interview problems from real interviews at Google, Meta, Anthropic. Jupyter notebooks, an auto-grader, and an MCP AI tutor.

linkedin / Liger-Kernel

Efficient Triton Kernels for LLM Training

ModelTC / LightLLM

LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

rpcpool / yellowstone-grpc

Triton's Dragon's Mouth Yellowstone gRPC service for high-performance Solana streaming

ome-projects / ome

Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, TensorRT-LLM, and Triton

JonathanSalwan / Triton

Triton is a dynamic binary analysis library. Build your own program analysis tools, automate your reverse engineering, perform software verification or just emulate code.

flagos-ai / FlagGems

FlagGems is an operator library for large language models implemented in the Triton Language.

triton-inference-server / tutorials

This repository contains tutorials and examples for Triton Inference Server

HKUSTDial / flash-sparse-attention

Trainable fast and memory-efficient sparse attention

QuadraV-Speech / CosyVoice3Pro

Production-ready CosyVoice serving with Triton, reusable Speaker Registry, Public HTTP API and Web console.

TritonDataCenter / smartos-live

For more information, please see http://smartos.org/ For any questions that aren't answered there, please join the SmartOS discussion list: https://smartos.topicbox.com/groups/smartos-discuss

triton-inference-server / tensorrtllm_backend

The Triton TensorRT-LLM Backend

triton-inference-server / client

Triton Python, C++ and Java client libraries, and GRPC-generated client examples for go, java and scala.

triton-inference-server / python_backend

Triton backend that enables pre-process, post-processing and other logic to be implemented in Python.

66RING / tiny-flash-attention

flash attention tutorial written in python, triton, cuda, cutlass

triton-inference-server / model_analyzer

Triton Model Analyzer is a CLI tool to help with better understanding of the compute and memory requirements of the Triton Inference Server models.

Krusty84 / triton-ascend-agent-dev-kit

A toolkit for AI agents used for development on Triton-Ascend for Ascend NPU

Saganaki22 / ComfyUI-sol-attn

NVIDIA Sol-Attn for ComfyUI / Triton kernel on SM89 - SM121, with zero-copy MiniMax H3 nodes: memory-efficient attention, scheduled tau with graph preview, and feed-forward chunking. Measured 1.14–1.44× vs SageAttention and −37% MLP peak VRAM on H3

MoonshotAI / minitriton

—

michaelc-yu / cs336-llm-systems

Large language model systems implementation and optimization: Transformers, BPE tokenization, FlashAttention, Triton, distributed training, GPU profiling, and GRPO reasoning RL

drowzeys / keys-SM121-Optimized-MiniMax-H3-Nvidia-Sol-Engine-Kijai-SolAttn_Triton-Single-DGX-Spark

MiniMax-H3 33B audio+video DiT accelerated 1.54x on a single NVIDIA DGX Spark (GB10, sm_121): NVIDIA Sol-Engine FirstBlockCache + batched VAE decode ported to single-GPU ComfyUI, Sol-Attn patched for compute 12.1, kijai Triton INT8/TMA kernels. Benchmarks, charts, one-shot installer, agent recipe.

VeriInfra-Lab / VeriTile

Lean 4 framework for reasoning about Triton-style kernels.

CoinCheung / BiSeNet

Add bisenetv2. My implementation of BiSeNet

JafarAkhondali / acer-predator-turbo-and-rgb-keyboard-linux-module

Linux kernel module to support Turbo mode and RGB Keyboard for Acer Predator notebook series

kijai / ComfyUI-SolAttn_triton

—

52Hz-kiko / mini-vllm-qwen3-serving

A Mini-vLLM optimization project for Qwen3-32B TP=2 serving, Prefix Cache, and Triton PagedAttention.

yanght27 / GPU-Perf-Playground

GPU 性能与 AI Infra 学习项目：CUDA/Triton 算子、NCU/NSYS、vLLM/SGLang/TRT-LLM/ms-swift、PyTorch/DeepSpeed/ms-swift 训练、并行架构

zengxiao-he / tessera

From teacher to tiles — a from-scratch LLM distillation & serving engine: custom Triton/CUDA kernels, FSDP distillation, paged-KV continuous batching, speculative decoding, a Rust gateway, a JAX oracle, and interpretability tooling.

RightNow-AI / autokernel

Autoresearch for GPU kernels. Give it any PyTorch model, go to sleep, wake up to optimized Triton kernels.