mw00 / project-maya

Project Maya - run GLM-5.3-Flash (321B MoE) and DeepSeek-V4.1-Flash-1017 (748B MoE) privately on your own GPU(s), from one card to 16, NVIDIA or AMD, Linux or Windows. Engine, server, dashboard, OpenAI- and Anthropic-compatible API, quant tools.

VecSzn / PolyStrata

Run large AI models on your own PC: Qwen3.8-Flash-Next on Strata's engine, and GLM 5.3 Flash, DeepSeek V4 Flash, LFM2.5, Qwen3.6, Ornith 1.5, Gemma 4, Tiel Coder and MiniCPM-V on a second engine written for PolyStrata. One-click install for Windows and Linux, OpenAI/Anthropic API on localhost.

Indras-Mirror / Xolotl

Xolotl (formerly Strata-DSV4.1): DeepSeek-V4.1-Flash, all 552B, on one gaming PC (RTX 4090 + 90 GB RAM) at ~27 tok/s, plus GLM-5.3-Flash, Qwen3.8-Flash-Next and Qwen3.8-27B. A heavily extended fork of Strata: MoE experts tiered across VRAM, pinned RAM and NVMe; OpenAI + Anthropic API.

harry7557558 / spirula-studio

Cross-vendor 3D Gaussian Splatting trainer - video to splat to mesh, Vulkan or CUDA.

flashrt-project / FlashRT

FlashRT is a high-performance realtime inference engine for small-batch, latency-sensitive AI workloads. The flagship integration is production VLA control for Pi0, Pi0.5, GROOT N1.6, and Pi0-FAST. Also support llm e.g, qwen3.6-27B

3145544645 / gouji

构屎 GOUJI — 纯 C++/CUDA 的三值 mini LLM。2 bit/权重，零 Python；联想记忆工具路由，零训练参数；143 个缺陷与 29 个变异测试记录在案。

CSUNX233 / qwen3.8-27b-ninfer-5070tilaptop-kvmem-local-agent

RTX 5070 Ti Laptop 12GB 跑 Qwen3.8-27B：NInfer + KVMem、256K 逻辑上下文、RAM KV、MTP、快速缓存续接与 dsh 本地 Agent / 搜索 / 浏览器。含源码、Windows 部署及实测。

NVIDIA / cutlass

CUDA Templates and Python DSLs for High-Performance Linear Algebra

MrNeRF / LichtFeld-Studio

Train, inspect, edit, automate, and export 3D Gaussian Splatting scenes from a single native application.

Luce-Org / lucebox

LLM speculative inference server for heterogeneous hardware & consumer GPUs

catboost / catboost

A fast, scalable, high performance Gradient Boosting on Decision Trees library, used for ranking, classification, regression and other machine learning tasks for Python, R, Java, C++. Supports computation on CPU and GPU.

Wallawalla47 / Infernix

C++/CUDA single-GPU inference engine for Qwen3.8 (incl. Qwen3.8-Flash-Next with offloaded experts) on the RTX 5090; grew from NInfer

isl-org / Open3D

Open3D: A Modern Library for 3D Data Processing

shader-slang / slang

Making it easier to work with shaders

chrxh / alien

ALIEN is a CUDA-powered artificial life simulation program.

NVIDIA / nccl

Optimized primitives for collective multi-GPU communication

iree-org / iree

A retargetable MLIR-based machine learning compiler and runtime toolkit.

uccl-project / uccl

UCCL is an efficient communication library for GPUs, covering collectives, P2P (e.g., KV cache transfer, RL weight transfer), and EP (e.g., GPU-driven)

sergqwer / strata-nvfp4

Strata fork: Qwen3.8-Flash-Next 125B MoE in NVFP4 on one RTX 20-50 card (12 GB+) and 64 GB of RAM or more. Setup installs our GPTQ quants (huihui abliterated, OrcaRouter) from Hugging Face. CPU experts on AVX-512 or AVX2 (+AVX-VNNI), all experts in RAM from 92 GB, a low-RAM mode below, vision, W4A8 prompts. Windows / CUDA 13.

Tylogi / TyloQuant

Get more intelligence from every bit. Better quantization formats and smarter calibration let larger, stronger models run smoothly on the hardware you already own.

LeelaChessZero / lc0

Open source neural network chess engine with GPU acceleration and broad hardware support.

jmaczan / tiny-vllm

Build your own high performance LLM inference engine in C++ and CUDA - a smaller version of vLLM

OpenNMT / CTranslate2

Fast inference engine for Transformer models

NVIDIA / cccl

CUDA Core Compute Libraries

wilicc / gpu-burn

Multi-GPU CUDA stress test

nvidia-isaac / cuVSLAM

CUDA-accelerated visual odometry and SLAM library for fast, accurate, low-latency camera tracking

1115714829 / llama.cpp-v100

llama.cpp optimized for NVIDIA Tesla V100 (SM70): Qwen3.8-Flash-Next with MTP (prefill 3402 tok/s at 200K context on 6x V100-16GB; also runs on 2x V100-16GB) and Qwen3.8-27B with DFlash2 (decode up to 220 tok/s); 2-6 GPUs, 262K-512K context, multimodal, concurrent serving, built-in web UI.

hardenedlinux / SonicBoom

A compiler-first PyTorch alternative. MLIR-based Boom IR, Guile scripting, CUDA and CPU. On consumer GPUs it already beats llama.cpp’s LLM decode with the same kernels; the compiler makes the difference. GPLv3.

gpgpu-sim / gpgpu-sim_distribution

GPGPU-Sim provides a detailed simulation model of contemporary NVIDIA GPUs running CUDA and/or OpenCL workloads. It includes support for features such as TensorCores and CUDA Dynamic Parallelism as well as a performance visualization tool, AerialVisoin, and an integrated energy model, GPUWattch.

luigifcruz / CyberEther

High-performance GPU-accelerated signal processing and visualization framework that runs anywhere.

JakeATX / llamAmpere

llama.cpp fork for significantly improved performance on Ampere (especially RTX 3090 / 3090 Ti): example: 95+ tok/s over a 100K-token generation at temperature 1 for qwen3.8, supporting full 262K ctx. Supports low memory (12gb) configs for 200k+ ctx

lupinemachines / lupine

LUPINE is a GPU over IP bridge allowing GPUs on remote machines to be attached to CPU-only machines.

NVIDIA / cuda-quantum

C++ and Python support for the CUDA Quantum programming model for heterogeneous quantum-classical workflows

LuisaGroup / LuisaCompute

High-Performance Rendering Framework on Stream Architectures

MeshInspector / MeshLib

3D geometry processing SDK: fast mesh boolean, mesh repair, decimation, remeshing, offset, point cloud triangulation and ICP registration. C++ with Python, C#, C and JavaScript bindings.

AmmarkoV / SAM3DBody-cpp

Real-time 3D full-body reconstruction from a single camera, Multiperson BVH output, Pure C++ runtime, ONNX + ggml, 70-joint skeleton with hands.

taskflow / taskflow

A General-purpose Task-parallel Programming System in C++

NVlabs / tiny-cuda-nn

Lightning fast C++/CUDA neural network framework

heavyai / heavydb

HeavyDB (formerly MapD/OmniSciDB)

erwincoumans / tiny-differentiable-simulator

Tiny Differentiable Simulator is a header-only C++ and CUDA physics library for reinforcement learning and robotics with zero dependencies.

LuxCoreRender / LuxCore

LuxCore source repository

uxlfoundation / oneMath

oneAPI Math Library (oneMath)

ginkgo-project / ginkgo

Numerical linear algebra software package

krrishnarraj / clpeak

Peak compute, memory bandwidth and latency of CPUs, GPUs and NPUs: the same tests through every API that reaches a device. Command line and app for Windows, macOS, Linux and Android

lkarlslund / laya.cpp

C++ inference for Laya typed decisions - supports CUDA, Vulkan, Core ML, CPU

poisonxa16 / pxa

The set-and-forget LLM engine for Pascal and Volta: PXQ codec + kernels, auto-tuned per card. Ready-to-run PXQ models in MODELS.md; benchmarks vs llama.cpp in the README.

ymcrcat / rgpu

Keep Python on your laptop. Run PyTorch operations and hold tensors on a remote GPU, including from a Mac with no CUDA installation.

doximity / mvcc

Compile and run CUDA on Apple M4-M5 GPUs

headpiece747 / ninfer-5090-windows

Native Windows port of NInfer engine for RTX 5090. Features Qwen3.8-27B with QUASAR and NInfer models, MTP/DFlash2 with vision and 262,144 context

ServeurpersoCom / yue2.cpp

Portable C++17 implementation of YuE2 AI Music Generator using GGML. Text + lyrics in, stereo 48kHz MP3 or WAV out. Runs on CPU, CUDA, ROCm, Metal, Vulkan.

DeepSeekV4Flash0731 / DeepSeek-V4-Flash-0731

DeepSeek V4 Flash 0731 - free deepseek v4 flash download, gguf, ollama, deepseek v4 pro 0813. deepseek v4 flash vs pro, benchmark, MoE, 1M context, compressed sparse attention, coding. CUDA/CPU, no API key, Windows local AI. Download:🡇

NVIDIA / cudf

cuDF - GPU DataFrame Library

ROCm / hip

HIP: C++ Heterogeneous-Compute Interface for Portability

FeiYull / TensorRT-Alpha

🔥🔥🔥TensorRT for YOLO26 (det/pose/seg/depth/obb/cls), YOLOv11,YOLOv10 YOLOv9,YOLOv8, ... 🚀🚀🚀 CUDA IS ALL YOU NEED. 🍎🍎🍎

NVIDIA / MatX

An efficient C++20 GPU numerical computing library with Python-like syntax

gunrock / gunrock

Programmable CUDA/C++ GPU Graph Analytics

NVIDIA / cuda-tile

CUDA Tile IR is an MLIR-based intermediate representation and compiler infrastructure for CUDA kernel optimization, focusing on tile-based computation patterns and optimizations targeting NVIDIA tensor core units.

eyalroz / cuda-api-wrappers

Thin, unified, C++-flavored wrappers for the CUDA APIs

ddemidov / amgcl

C++ library for solving large sparse linear systems with algebraic multigrid method

invergent-ai / surogate

Train and serve LLMs at extreme speed and massive throughput.