jasmcaus / caer
High-performance Vision library in Python. Scale your research, not boilerplate.
jasmcaus / caer
ARahim3 / kaggle-tpu-lab
Frontier-class open models on a free Kaggle TPU v5e-8: GLM-5.3-Flash 320B MoE (~165 tok/s, our own JAX engine) and Qwen3.8-27B bf16 (~130 tok/s), 262k context, prefix caching. Works with Claude Code, Codex, opencode and pi.
MiaAI-Lab / Qwen3.8-27B-16gb-NVIDIA-GPUs-one-click-install
Qwen3.8-27B on 16-32 GB Nvidia GPUs one-click install for Windows / Linux
sudoingX / qwen38-mtp
One llama.cpp flag unlocks +33-39% decode speed for Qwen3.8-27B on consumer GPUs. The MTP head already ships inside your GGUF. Recipe, paired benchmarks, probe tool.
wtdcode / vllm-backport
Dogfooding vLLM backport for older GPUs.
morluto / flameox
Runtime evidence that helps agents trace, profile, and burn down hotspots in application and native code, GPU kernels, and inference stacks.
sudoingX / local-ai-on-your-gaming-gpu
run a 27b local ai on your gaming gpu, rtx 3060 and up, radeon rx 6600 and up in beta, 8gb or more, linux and windows, one line to install
jonathanhawkins / microduck-lab
Train RL policies for the Pollen Microduck 🦆 on an ordinary Mac, no CUDA GPU, and watch them learn live in the browser.
humza-khalid / 12vhpwr-guard
Standalone per-pin 12VHPWR overcurrent watchdog for ASUS ROG Astral GPUs. Shuts down your PC before the connector melts.
drpwchen / lecture-to-notes
Lecture recordings → structured grounded notes + a synced HTML viewer: video, timestamped transcript and curated summary on one page. Local GPU pipeline (Whisper ASR · slide extraction · OCR · VLM signals · capture-time alignment). Claude Code skill + plain CLI.
star7code / minimax-h3-chunk-star7
VRAM-efficient MiniMax H3 for ComfyUI: QKV/RoPE/MLP activation chunking, automatic OOM chunk reduction, and CK/SLA/Sol/Hybrid attention for SM75 and SM80+ GPUs.
NaiveAI-Labs / NaiveRT
NaiveRT: a self-contained TP8 inference runtime for the Naive N series on eight Blackwell GPUs with UMMA support. One persistent CUDA graph per rank runs draft, eight-row verify, top-p sampling and cache commit with no host in the loop: 1,700 tokens/s at batch size 1, one-second peaks above 2,000.
intel / gpu-ai-skills
Agent Skills for running, benchmarking, and profiling Hugging Face models on Intel GPUs — PyTorch, vLLM-XPU, and SGLang-XPU
mlc-ai / TIRx-kernels
Curated high-performance TIRx GPU kernels
PKU-DAIR / PipeLink
A linker for partial GPU kernels.
sjespersen / homelab-agent
Started as a €70 used mini PC running an always-on AI agent (Hermes, n8n, Pi-hole, monitoring, Tailscale, encrypted backups). Now with a second stack next to it: a homelabbed GPU server for local AI (Qwen 27B and Flash-Next, image generation, Ollama, one API). All as code.
Lightning-AI / pytorch-lightning
Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.
apache / tvm
Open Machine Learning Compiler Framework
plasma-umass / scalene
Scalene: a high-performance, high-precision CPU, GPU, and memory profiler for Python with AI-powered optimization proposals
triton-inference-server / server
The Triton Inference Server provides an optimized cloud and edge inferencing solution.
EleutherAI / gpt-neox
An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries
NVIDIA / cuml
NVIDIA cuML: GPU-Accelerated Machine Learning
transformerlab / transformerlab-app
The open source research environment for AI researchers to seamlessly train, evaluate, and scale models from local hardware to GPU clusters.
facebookincubator / AITemplate
AITemplate is a Python framework which renders neural network into high performance CUDA/HIP C++ code. Specialized for FP16 TensorCore (NVIDIA GPU) and MatrixCore (AMD GPU) inference.
wookayin / gpustat
📊 A simple command-line utility for querying and monitoring GPU status
cornellius-gp / gpytorch
A highly efficient implementation of Gaussian Processes in PyTorch
Jittor / jittor
Jittor is a high-performance deep learning framework based on JIT compiling and meta-operators.
torinmb / mediapipe-touchdesigner
GPU Accelerated MediaPipe Plugin for TouchDesigner
leptonai / leptonai
A Pythonic framework to simplify AI service building
pyro-ppl / numpyro
Probabilistic programming with NumPy powered by JAX for autograd and JIT compilation to GPU/TPU/CPU.
rbonghi / jetson_stats
📊 Simple package for monitoring and control your NVIDIA Jetson [Orin, Xavier, Nano, TX] series
graphistry / pygraphistry
PyGraphistry is a Python library to quickly load, shape, embed, and explore big graphs with the GPU-accelerated Graphistry visual graph analyzer
data-infra / cube-studio
cubestudio开源云原生一站式机器学习/深度学习/大模型AI平台/MaaS/mlops/人工智能平台/训推平台，算法全链路流程，多租户，算力租赁平台，token中转，拖拉拽任务流pipeline编排，多机多卡分布式训练，超参搜索，推理服务，VGPU虚拟化，云边端协同，边缘计算，自动化标注平台，deepseek等大模型sft微调/奖励模型/强化学习训练，vllm/ollama/mindie大模型多机推理，私有知识库llmops智能体，AI模型市场，支持国产异构算力调度,昇腾/寒武纪/海光/摩尔/沐曦等，支持ib/roce/RDMA，信创支持
NVlabs / ProtoMotions
ProtoMotions is a GPU-accelerated simulation and learning framework for training physically simulated digital humans and humanoid robots.
microsoft / Olive
Olive: Simplify ML Model Finetuning, Conversion, Quantization, and Optimization for CPUs, GPUs and NPUs.
dstackai / dstack
A unified orchestration layer for heterogeneous AI compute. It standardizes how to manage compute and run training and inference on GPU clouds, Kubernetes, VMs, or bare-metal clusters.
cfregly / ai-performance-engineering
Code, labs, and resources for O'Reilly AI Systems Performance Engineering: GPU optimization, distributed training, inference scaling, and full-stack tuning.
inducer / pycuda
CUDA integration for Python, plus shiny features
NVIDIA-AI-Blueprints / video-search-and-summarization
NVIDIA AI Blueprint for video search and summarization (VSS) is a GPU-accelerated reference architecture for building video analytics agents with real-time verified alerts, visual Q&A, and automated reporting. The VSS Blueprint uses vision language models (VLMs) such as NVIDIA Cosmos, LLMs such as NVIDIA Nemotron, RAG, and NVIDIA NIMs.
BindsNET / bindsnet
Simulation of spiking neural networks (SNNs) using PyTorch.
fastplotlib / fastplotlib
Next-gen fast plotting library running on WGPU using the pygfx rendering engine
NVIDIA / deepops
Tools for building GPU clusters
zed-industries / awesome-gpui
Awesome projects, built with or for GPUI!
uxlfoundation / scikit-learn-intelex
Extension for Scikit-learn is a seamless way to speed up your Scikit-learn application
modal-labs / modal-examples
Examples of programs built using Modal
ModelCloud / GPTQModel
LLM model quantization (compression) toolkit with HW acceleration support for Nvidia, AMD, Intel GPU and Intel/AMD/Apple CPU via HF, vLLM, and SGLang.
AlphaGPU / leetgpu-challenges
LeetGPU Challenges
meta-pytorch / torchcodec
Media decoding and encoding for PyTorch: videos, images, and audio, on CPU and GPU.
inducer / pyopencl
OpenCL integration for Python, plus shiny features
nnaisense / evotorch
Advanced evolutionary computation library built directly on top of PyTorch, created at NNAISENSE.
leggedrobotics / elevation_mapping_cupy
Elevation Mapping on GPU.
CrossGL / crosstl
Translate GPU shaders and compute kernels between Metal, HLSL and GLSL, and to SPIR-V and WGSL, through the CrossGL IR
optiland / optiland
Comprehensive optical design, optimization, and analysis in Python, including GPU-accelerated and differentiable ray tracing via PyTorch.
dgasmith / opt_einsum
⚡️Optimizing einsum functions in NumPy, Tensorflow, Dask, and more with contraction order optimization.
VocaHQ / vocalinux
Free, open-source, 100% offline voice dictation for Linux. Speak and type anywhere via whisper.cpp, Whisper & VOSK engines, GPU-accelerated, works on X11 + Wayland!
JMS1717 / 8mb.local
a free local self hosted video compressor webui designed for performance and ease of use. inspired by 8mb.video
XTraceAI / cuhepy
GPU-accelerated homomorphic encryption in Python: Paillier and BFV, with encrypted nearest-neighbour search. Experimental research code.
TheStageAI / TheWhisper
Optimized Whisper models for streaming and on-device use
mosecorg / mosec
A high-performance ML model serving framework, offers dynamic batching and CPU/GPU pipelines to fully exploit your compute machine
gprMax / gprMax
gprMax is open source software that simulates electromagnetic wave propagation using the Finite-Difference Time-Domain Finite-Difference (FDTD) code for numerical modelling of Ground Penetrating Radar (GPR), antennas, radar and bioelectromagnetics