longbridge / gpui-kit

Rust GUI components for building fantastic cross-platform desktop application by using GPUI.

gfx-rs / wgpu

A cross-platform, safe, pure-Rust graphics API.

NVIDIA / open-gpu-kernel-modules

NVIDIA Linux open GPU kernel module source

playcanvas / engine

Powerful web graphics runtime built on WebGL, WebGPU, WebXR and glTF

exaloop / codon

A high-performance, zero-overhead, extensible Python compiler with built-in NumPy support

tracel-ai / burn

Burn is a next generation tensor library and Deep Learning Framework that doesn't compromise on flexibility, efficiency and portability.

seerge / g-helper

Lightweight Armoury Crate alternative for Asus laptops with nearly the same functionality. Works with ROG Zephyrus, Flow, TUF, Strix, Scar, ProArt, Vivobook, Zenbook, Expertbook, ROG Ally, and more.

gpujs / gpu.js

GPU Accelerated JavaScript

neovide / neovide

No Nonsense Neovim Client in Rust

NVIDIA / TensorRT-LLM

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.

deeplearning4j / deeplearning4j

Suite of tools for deploying and training deep learning models using the JVM. Highlights include model import for keras, tensorflow, and onnx/pytorch, a modular and tiny c++ library for running math code and a java based math library on top of the core c++ library. Also includes samediff: a pytorch/tensorflow like library for running deep learn...

isl-org / Open3D

Open3D: A Modern Library for 3D Data Processing

apache / tvm

Open Machine Learning Compiler Framework

openwall / john

John the Ripper jumbo - advanced offline password cracker, which supports hundreds of hash and cipher types, and runs on many operating systems, CPUs, GPUs, and even some FPGAs

plasma-umass / scalene

Scalene: a high-performance, high-precision CPU, GPU, and memory profiler for Python with AI-powered optimization proposals

NVIDIA / TensorRT

NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.

adam-maj / tiny-gpu

A minimal GPU design in Verilog to learn how GPUs work from the ground up

cupy / cupy

NumPy & SciPy for GPU

taskflow / taskflow

A General-purpose Task-parallel Programming System in C++

optiscaler / OptiScaler

OptiScaler bridges upscaling/frame gen across GPUs. Supports DLSS2+/XeSS/FSR2+ inputs, replaces native upscalers, enables FSR-FG/XeFG on non-FG titles. Supports Nukem mod for DLSSG-to-FSR3 FG.

triton-inference-server / server

The Triton Inference Server provides an optimized cloud and edge inferencing solution.

Syllo / nvtop

GPU & Accelerator process monitoring for AMD, Apple, Huawei, Intel, NVIDIA and Qualcomm

skypilot-org / skypilot

The AI Compute Platform for frontier teams. SkyPilot turns fragmented AI compute into one AI supercomputer, so frontier AI teams build custom intelligence faster.

Const-me / Whisper

High-performance GPGPU inference of OpenAI's Whisper automatic speech recognition (ASR) model

NVIDIA / cutlass

CUDA Templates and Python DSLs for High-Performance Linear Algebra

CyberTimon / RapidRAW

A beautiful, non-destructive, and GPU-accelerated RAW image editor built with performance in mind.

playcanvas / supersplat

3D Gaussian Splat Editor

xmrig / xmrig

RandomX, KawPow, CryptoNight and GhostRider unified CPU/GPU miner and RandomX benchmark

cocos / cocos-engine

Cocos simplifies game creation and distribution with Cocos Creator, a free, open-source, cross-platform game engine. Empowering millions of developers to create high-performance, engaging 2D/3D games and instant web entertainment.

NVIDIA / cudf

cuDF - GPU DataFrame Library

gyroflow / gyroflow

Video stabilization using gyroscope data

MakazhanAlpamys / Soup

Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.

KytyPS5 / KytyPS5

PlayStation 5 translation layer for Windows, Linux and macOS

crynta / terax-ai

Lightweight (7MB) terminal-first AI-native development environment

flightlessmango / MangoHud

A Vulkan and OpenGL overlay for monitoring FPS, temperatures, CPU/GPU load and more.

catboost / catboost

A fast, scalable, high performance Gradient Boosting on Decision Trees library, used for ranking, classification, regression and other machine learning tasks for Python, R, Java, C++. Supports computation on CPU and GPU.

open-pencil / open-pencil

AI-native design editor. Open-source Figma alternative.

FareedKhan-dev / kimi-k3-in-c

A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.

deepseek-ai / DeepGEMM

DeepGEMM: clean and efficient BLAS kernel library on GPU

tile-ai / tilelang

Domain-specific language designed to streamline the development of high-performance GPU/CPU/Accelerators kernels

zeux / meshoptimizer

Mesh optimization library that makes meshes smaller and faster to render

qualcomm / GenieX

Run frontier LLMs and VLMs locally on Qualcomm devices across NPU, GPU, and CPU with a few lines of code

lightningpixel / modly

Desktop app to generate 3D models from images or prompt using local AI — runs entirely on your GPU

raphamorim / rio

A hardware-accelerated GPU terminal emulator focusing to run in desktops and browsers.

h2oai / h2o-3

H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.

EleutherAI / gpt-neox

An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries

XuehaiPan / nvitop

An interactive NVIDIA-GPU process viewer and beyond, the one-stop solution for GPU process management.

NVIDIA / warp

A Python framework for GPU-accelerated simulation, robotics, and machine learning.

drumih / turbo-fieldfare

Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook

bojieli / ai-infra-book

《深入理解 AI Infra：量化分析与系统设计》（李博杰 著）开源书稿：从硬件约束和模型架构出发，量化推导 LLM 推理与训练系统设计。含全书正文、PDF、配套计算工具与实验

flashinfer-ai / flashinfer

FlashInfer: Kernel Library for LLM Serving

Diorser / LiteMonitor

一款轻量级、高度可定制的 Windows桌面和任务栏硬件性能监控工具，支持监测 CPU、GPU、内存、磁盘、网速、FPS 计数、插件扩展及内存清理。A lightweight, customizable hardware monitor for the Windows desktop & taskbar. Features CPU/GPU/RAM/Network monitoring, FPS counter, plugin support, and memory optimization.

halide / Halide

a language for fast, portable data-parallel computation

koharu-rs / koharu

ML-powered manga translator, written in Rust.

melonjs / melonJS

a modern & lightweight HTML5 game engine

harfbuzz / harfbuzz

HarfBuzz text shaping engine

higgsfield-ai / higgsfield

Fault-tolerant, highly scalable GPU orchestration, and a machine learning framework designed for training models with billions to trillions of parameters

Michael-A-Kuykendall / shimmy

⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.

lemonade-sdk / lemonade

Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk

gpustack / gpustack

A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.