kanaworksai-hue / audio-studio-mcp
Local AI BGM and sound effects for Claude Code and any MCP client. Stable Audio 3 on Apple Silicon (MLX) and Windows NVIDIA GPUs (PyTorch). No cloud, no API key.
kanaworksai-hue / audio-studio-mcp
dashdogy / MFG-Unlocker
Experimental DLSS Multi Frame Generation controls for any supported MFG title on RTX 40 series GPUs
Panchovix / nvidia-windows-vbios-vix-loader
Load a modified VBIOS for NVIDIA GPUs on Windows through the driver's registry override, without flashing
vosen / ZLUDA
Drop-in CUDA replacement that runs unmodified CUDA applications on non-NVIDIA GPUs.
optiscaler / OptiScaler
OptiScaler bridges upscaling/frame gen across GPUs. Supports DLSS2+/XeSS/FSR2+ inputs, replaces native upscalers, enables FSR-FG/XeFG on non-FG titles. Supports Nukem mod for DLSSG-to-FSR3 FG.
NVIDIA / TensorRT-LLM
TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.
lonewolf0622 / HelixSR
Drop-in FSR 3.1 upscaler for Direct3D 12 that runs DLSS's network (Model E) on AMD GPUs
syv-ai / HyperQwen
Serve large Qwen models fast on the GPUs you actually own. Qwen3.8-27B on a single 24 GB card with vLLM: 127 tok/s single-user (381 when the answer quotes the prompt), ~1,035 tok/s at 64 concurrent, 150k-262k context. vLLM patches, requant pipeline, benchmarks.
ashhart / TensorFold
Serves language models from a Zig binary on Apple Silicon and NVIDIA GPUs using Metal and CUDA kernels.
lemonade-sdk / lemonade
Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk
D-Ogi / amdgpu-wddm
Open Windows (WDDM) driver stack for AMD GPUs, developed first on the ASRock BC-250 (gfx1013). Not affiliated with AMD, ASRock or Microsoft.
Neroued / ninfer
High-performance single-GPU inference for selected model checkpoints and GPUs.
baidu-baige / LoongForge
A high-performance framework for training LLMs, VLMs, diffusion, and embodied models on NVIDIA GPUs and Kunlun XPUs. Supports Pi0.5, GR00T-N1.7, FastWAM, Cosmos3, DreamZero, DeepSeek-V4, GLM-5.3, Kimi-K3 and more.
turboderp-org / exllamav3
An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs
b00t0x / WhateverXe
Various patches necessary for certain Intel Xe iGPUs
openwall / john
John the Ripper jumbo - advanced offline password cracker, which supports hundreds of hash and cipher types, and runs on many operating systems, CPUs, GPUs, and even some FPGAs
noonghunna / club-3090
Community recipes for serving LLMs on RTX 3090/4090/5090 CUDA gpus. Multi-engine (vLLM, sglang, llama.cpp and other custom engines) and model-agnostic. Currently shipping Qwen3.8-27B Qwen3.6 35B Gemma 4 26B Gemma 4 31B configs for 1×/2×/4x/8x cards.
gpustack / gpustack
A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.
uxlfoundation / oneDNN
Open-source library of optimized deep learning operations (matmul, convolution, attention) for CPUs (x64, AArch64, RISC-V) and Intel GPUs. Used by PyTorch, TensorFlow, OpenVINO, and ONNX Runtime.
NVIDIA / TransformerEngine
A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit and 4-bit floating point (FP8 and FP4) precision on Hopper, Ada and Blackwell GPUs, to provide better performance with lower memory utilization in both training and inference.
Luce-Org / lucebox
LLM speculative inference server for heterogeneous hardware & consumer GPUs
local-inference-lab / rtx6kpro
RTX 6000 Pro Wiki — Running Large LLMs (Qwen3.5-397B, Kimi-K2.5, GLM-5) on PCIe GPUs without NVLink
3zwr1 / AMD-NR---OptiScaler
DLSS 5 Neural Rendering on AMD GPUs, built into OptiScaler: model interleave, residual composition, XeSS frame generation up to 6X, FSR Ray Regeneration. Discord: https://discord.gg/AMDNR · Ko-fi: https://ko-fi.com/3zinr
InfiniTensor / InfiniTensor
InfiniTensor is a high-performance inference engine tailored for GPUs and AI accelerators. Its design focuses on effective deployment and swift academic validation.
Almosst-DEV / Cobalt64
Cobalt64: native macOS GPU acceleration for unsupported AMD Radeon GPUs. First supported family: RDNA4 (RX 9070 XT / Navi 48). Kernel driver, RADV Darwin port, Metal-on-Vulkan bundle.
bitcloud-ai / Bittune
Local-first engineering agent that deploys, benchmarks and tunes vLLM/SGLang inference services on your own GPUs, with auditable run evidence.
stas00 / ml-engineering
Machine Learning Engineering Open Book
ProjectPhysX / FluidX3D
The fastest and most memory efficient lattice Boltzmann CFD software, running on all GPUs and CPUs via OpenCL. Free for non-commercial use.
NVIDIA / nvidia-container-toolkit
Build and run containers leveraging NVIDIA GPUs
pytorch / TensorRT
PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT
NVIDIA / cutile-python
cuTile is a programming model for writing parallel kernels for NVIDIA GPUs
uccl-project / uccl
UCCL is an efficient communication library for GPUs, covering collectives, P2P (e.g., KV cache transfer, RL weight transfer), and EP (e.g., GPU-driven)
NVIDIA / DCGM
NVIDIA Data Center GPU Manager (DCGM) is a project for gathering telemetry and measuring the health of NVIDIA GPUs
MiaAI-Lab / Qwen3.8-27B-16gb-NVIDIA-GPUs-one-click-install
Qwen3.8-27B on 16-32 GB Nvidia GPUs one-click install for Windows / Linux
mehtabmahir / easy-whisper-ui
Easy to use interface for the Whisper model optimized for all GPUs!
amitshekhariitbhu / llm-inference-engineering
Learn LLM Inference Engineering step by step - from KV cache, PagedAttention, and continuous batching to vLLM, SGLang, and GPUs.
sudoingX / qwen38-mtp
One llama.cpp flag unlocks +33-39% decode speed for Qwen3.8-27B on consumer GPUs. The MTP head already ships inside your GGUF. Recipe, paired benchmarks, probe tool.
wtdcode / vllm-backport
Dogfooding vLLM backport for older GPUs.
Headmaster218 / MoE4All
Run MoE models beyond VRAM on AMD, NVIDIA & Intel GPUs. Vulkan-powered, portable Windows app with automatic setup. | 让游戏显卡跑起超显存大模型，支持 AMD、NVIDIA、Intel，免安装、自动配置。只需13MB，即下即用！
countervolts / d4r
NVIDIA's official DLSS 3/4/4.5 on AMD RDNA3/4 GPUs on Windows and Linux.
Balemuni / Balemunis-Aurora
Custom Mesa Turnip driver build for Adreno GPUs
Ghael-V / Lemon-Project
Android-only Nintendo Switch emulator for Adreno GPUs: new interface, Lemon Cheater memory editor, savestates and NSZ/XCZ support. Mirror of git.lemon-emu.org/lemon/Lemon-Project
humza-khalid / 12vhpwr-guard
Standalone per-pin 12VHPWR overcurrent watchdog for ASUS ROG Astral GPUs. Shuts down your PC before the connector melts.
star7code / minimax-h3-chunk-star7
VRAM-efficient MiniMax H3 for ComfyUI: QKV/RoPE/MLP activation chunking, automatic OOM chunk reduction, and CK/SLA/Sol/Hybrid attention for SM75 and SM80+ GPUs.
doximity / mvcc
Compile and run CUDA on Apple M4-M5 GPUs
NaiveAI-Labs / NaiveRT
NaiveRT: a self-contained TP8 inference runtime for the Naive N series on eight Blackwell GPUs with UMMA support. One persistent CUDA graph per rank runs draft, eight-row verify, top-p sampling and cache commit with no host in the loop: 1,700 tokens/s at batch size 1, one-second peaks above 2,000.
intel / gpu-ai-skills
Agent Skills for running, benchmarking, and profiling Hugging Face models on Intel GPUs — PyTorch, vLLM-XPU, and SGLang-XPU
Lightning-AI / pytorch-lightning
Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.
adam-maj / tiny-gpu
A minimal GPU design in Verilog to learn how GPUs work from the ground up
EleutherAI / gpt-neox
An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries
openxla / xla
A machine learning compiler for GPUs, CPUs, and ML accelerators
wookayin / gpustat
📊 A simple command-line utility for querying and monitoring GPU status
acidanthera / WhateverGreen
Various patches necessary for certain ATI/AMD/Intel/Nvidia GPUs
ARM-software / ComputeLibrary
The Compute Library is a set of computer vision and machine learning functions optimised for both Arm CPUs and GPUs using SIMD technologies.
NVIDIA / gpu-operator
NVIDIA GPU Operator creates, configures, and manages GPUs in Kubernetes
lupinemachines / lupine
LUPINE is a GPU over IP bridge allowing GPUs on remote machines to be attached to CPU-only machines.
microsoft / Olive
Olive: Simplify ML Model Finetuning, Conversion, Quantization, and Optimization for CPUs, GPUs and NPUs.
AdaptiveCpp / AdaptiveCpp
Compiler for multiple programming models (SYCL, C++ standard parallelism, HIP/CUDA) for CPUs and GPUs from all vendors: The independent, community-driven compiler for C++-based heterogeneous programming models. Lets applications adapt themselves to all the hardware in the system - even at runtime!
gpgpu-sim / gpgpu-sim_distribution
GPGPU-Sim provides a detailed simulation model of contemporary NVIDIA GPUs running CUDA and/or OpenCL workloads. It includes support for features such as TensorCores and CUDA Dynamic Parallelism as well as a performance visualization tool, AerialVisoin, and an integrated energy model, GPUWattch.
Tencent / tgfx
A lightweight 2D graphics library for modern GPUs, delivering high-performance text, image, and vector rendering across major platforms.