NVIDIA / gpu-operator
NVIDIA GPU Operator creates, configures, and manages GPUs in Kubernetes
NVIDIA / gpu-operator
diku-dk / futhark
:boom::computer::boom: A data-parallel functional programming language
CVCUDA / CV-CUDA
CV-CUDAβ’ is an open-source, GPU accelerated library for cloud-scale image processing and computer vision.
meta-pytorch / torchrec
Pytorch domain library for recommendation systems
NVIDIA / cccl
CUDA Core Compute Libraries
NVIDIA / CUDALibrarySamples
CUDA Library Samples
lupinemachines / lupine
LUPINE is a GPU over IP bridge allowing GPUs on remote machines to be attached to CPU-only machines.
tracel-ai / cubecl
Multi-platform high-performance compute language extension for Rust.
noonghunna / club-3090
Community recipes for serving LLMs on RTX 3090/4090/5090 CUDA gpus. Multi-engine (vLLM, sglang, llama.cpp and other custom engines) and model-agnostic. Currently shipping Qwen3.8-27B Qwen3.6 35B Gemma 4 26B Gemma 4 31B configs for 1Γ/2Γ/4x/8x cards.
wilicc / gpu-burn
Multi-GPU CUDA stress test
apache / mahout
Apache Mahout - an environment for quickly creating scalable, performant machine learning applications.
rapidsai / cugraph
cuGraph - RAPIDS Graph Analytics Library
withcatai / node-llama-cpp
Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level
syv-ai / HyperQwen
Serve large Qwen models fast on the GPUs you actually own. Qwen3.8-27B on a single 24 GB card with vLLM: 127 tok/s single-user (381 when the answer quotes the prompt), ~1,035 tok/s at 64 concurrent, 150k-262k context. vLLM patches, requant pipeline, benchmarks.
deepmodeling / deepmd-kit
A deep learning package for many-body potential energy representation and molecular dynamics
inducer / pycuda
CUDA integration for Python, plus shiny features
pykeen / pykeen
π€ A Python library for learning and evaluating knowledge graph embeddings
AdaptiveCpp / AdaptiveCpp
Compiler for multiple programming models (SYCL, C++ standard parallelism, HIP/CUDA) for CPUs and GPUs from all vendors: The independent, community-driven compiler for C++-based heterogeneous programming models. Lets applications adapt themselves to all the hardware in the system - even at runtime!
SemiAnalysisAI / InferenceX
Open Source AI Accelerator Research Platform Standard / εΌζΊζ¨ηη η©ΆεΉ³ε°
dphnAI / sonar
Large-scale LLM inference engine
nvidia-isaac / cuVSLAM
CUDA-accelerated visual odometry and SLAM library for fast, accurate, low-latency camera tracking
beam-cloud / beta9
Ultrafast serverless GPU inference, sandboxes, and background jobs
harry7557558 / spirula-studio
Cross-vendor 3D Gaussian Splatting trainer - video to splat to mesh, Vulkan or CUDA.
m4rs-mt / ILGPU
ILGPU JIT Compiler for high-performance .Net GPU programs
gpgpu-sim / gpgpu-sim_distribution
GPGPU-Sim provides a detailed simulation model of contemporary NVIDIA GPUs running CUDA and/or OpenCL workloads. It includes support for features such as TensorCores and CUDA Dynamic Parallelism as well as a performance visualization tool, AerialVisoin, and an integrated energy model, GPUWattch.
tenstorrent / tt-metal
:metal: TT-NN operator library, and TT-Metalium low level kernel programming model.
sgl-project / sglang-omni
SGLang-Omni is a high-performance serving framework for audio models (TTS, ASR) and unified multimodal models.
uccl-project / uccl
UCCL is an efficient communication library for GPUs, covering collectives, P2P (e.g., KV cache transfer, RL weight transfer), and EP (e.g., GPU-driven)
datawhalechina / zero-to-sglang
Official SGLang x Datawhale course on LLM inference: understand inference, build a mini-sglang from scratch, then read the real SGLang source and land your first PR. Available in English and Chinese.
beehive-lab / TornadoVM
Write Java. Run on GPUs. Fast.
FeiYull / TensorRT-Alpha
π₯π₯π₯TensorRT for YOLO26 (det/pose/seg/depth/obb/cls), YOLOv11,YOLOv10 YOLOv9,YOLOv8, ... πππ CUDA IS ALL YOU NEED. πππ
NVIDIA / MatX
An efficient C++20 GPU numerical computing library with Python-like syntax
JuliaGPU / CUDA.jl
CUDA programming in Julia.
NVlabs / kda
Kernel Design Agents (KDA) is a agent-centric workflow to write high-performance CUDA Kernels.
ashhart / TensorFold
LLM Inference Engine for Metal and CUDA.
mratsim / Arraymancer
A fast, ergonomic and portable tensor library in Nim with a deep learning focus for CPU, GPU and embedded devices via OpenMP, Cuda and OpenCL backends
erwincoumans / tiny-differentiable-simulator
Tiny Differentiable Simulator is a header-only C++ and CUDA physics library for reinforcement learning and robotics with zero dependencies.
open-edge-platform / geti
Build, train, optimize, and run computer vision models locally, from raw images to live inference. Open source, optimized for Intel XPU (CPU-only and CUDA also supported).
LuxCoreRender / LuxCore
LuxCore source repository
mw00 / project-maya
Project Maya - run GLM-5.3-Flash (321B MoE) and DeepSeek-V4.1-Flash-1017 (748B MoE) privately on your own GPU(s), from one card to 16, NVIDIA or AMD, Linux or Windows. Engine, server, dashboard, OpenAI- and Anthropic-compatible API, quant tools.
chelsea0x3b / cudarc
Safe rust wrapper around CUDA toolkit
markus-perl / ffmpeg-build-script
The FFmpeg build script provides an easy way to build a static FFmpeg on OSX and Linux with non-free codecs included.
NVIDIA / cuda-quantum
C++ and Python support for the CUDA Quantum programming model for heterogeneous quantum-classical workflows
jmaczan / tiny-vllm
Build your own high performance LLM inference engine in C++ and CUDA - a smaller version of vLLM
inducer / pyopencl
OpenCL integration for Python, plus shiny features
NVIDIA / cuopt
GPU accelerated decision optimization
LuisaGroup / LuisaCompute
High-Performance Rendering Framework on Stream Architectures
NVIDIA / raft
RAFT contains fundamental widely-used algorithms and primitives for machine learning and information retrieval. The algorithms are CUDA-accelerated and form building blocks for more easily writing high performance applications.
NVIDIA / cuda-tile
CUDA Tile IR is an MLIR-based intermediate representation and compiler infrastructure for CUDA kernel optimization, focusing on tile-based computation patterns and optimizations targeting NVIDIA tensor core units.
timoncool / YuE2-Studio
Local AI song generator with an editable score β YuE2 on your GPU: full songs with vocals, sheet music, covers, exact replay. Native Windows app, no Python, installer with auto-update.
NVIDIA / cudnn-frontend
cuDNN Frontend is NVIDIA's modern, open-source entry point to the cuDNN library and a growing collection of high-performance open-source kernels.
Motphys / UniLab
UniLab: A Heterogeneous Architecture for Robot RL Beyond GPU-Dominant Paradigms
NVIDIA / nvbench
CUDA Kernel Benchmarking Library
XTraceAI / cuhepy
GPU-accelerated homomorphic encryption in Python: Paillier and BFV, with encrypted nearest-neighbour search. Experimental research code.
eyalroz / cuda-api-wrappers
Thin, unified, C++-flavored wrappers for the CUDA APIs
gprMax / gprMax
gprMax is open source software that simulates electromagnetic wave propagation using the Finite-Difference Time-Domain Finite-Difference (FDTD) code for numerical modelling of Ground Penetrating Radar (GPR), antennas, radar and bioelectromagnetics
ddemidov / amgcl
C++ library for solving large sparse linear systems with algebraic multigrid method
NVIDIA / cuvs
cuVS - a library for vector search and clustering on the GPU
insight-platform / Savant
Python Computer Vision & Video Analytics Framework With Batteries Included
luigifcruz / CyberEther
High-performance GPU-accelerated signal processing and visualization framework that runs anywhere.