debpalash / VoiceStudio
VoiceStudio is the open-source, fully-local ElevenLabs alternative โ voice cloning, voice design, video dubbing, dictation, transcription & audiobook creation in 646 languages.
debpalash / VoiceStudio
kanaworksai-hue / audio-studio-mcp
Local AI BGM and sound effects for Claude Code and any MCP client. Stable Audio 3 on Apple Silicon (MLX) and Windows NVIDIA GPUs (PyTorch). No cloud, no API key.
vosen / ZLUDA
CUDA on non-NVIDIA GPUs
plotarmordev / drama-tensorfold
Fish Audio Drama 3 text-to-speech on the TensorFold native CUDA engine for DGX Spark (GB10): recipe, engine patches, benchmarks. Built with Fish Audio.
surya-koritala / condor
Qwen3.8-Flash-Next (180B MoE) on one 12-16 GB NVIDIA GPU, Linux or Windows. Own engine, own compression.
lxe / dsx
DeepSeek-V4.1-Flash-1017 (552B MoE) on 2x RTX 3090 + 128 GB RAM: Rust + CUDA engine and 2-bit quant. 30-37 tok/s decode.
CSUNX233 / qwen3.8-27b-ninfer-5070tilaptop-kvmem-local-agent
RTX 5070 Ti Laptop 12GB ่ท Qwen3.8-27B๏ผNInfer + KVMemใ256K ้ป่พไธไธๆใRAM KVใMTPใๅฟซ้็ผๅญ็ปญๆฅไธ dsh ๆฌๅฐ Agent / ๆ็ดข / ๆต่งๅจใๅซๆบ็ ใWindows ้จ็ฝฒๅๅฎๆตใ
vllm-project / vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
jamiepine / voicebox
The open-source AI voice studio. Clone, dictate, create.
sgl-project / sglang
SGLang is a high-performance serving framework for large language models and multimodal models.
hashcat / hashcat
World's fastest and most advanced password recovery utility
antirez / ds4
DeepSeek 4 Flash and PRO local inference engine for Metal, CUDA and ROCm
bendlang / bend
Bend 2: a fast language that blocks AI mistakes via proof. Install: curl -fsSL https://bend-lang.com/install.sh | sh
tracel-ai / burn
Burn is a next generation tensor library and Deep Learning Framework that doesn't compromise on flexibility, efficiency and portability.
NVIDIA / TensorRT-LLM
TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.
isl-org / Open3D
Open3D: A Modern Library for 3D Data Processing
ace-step / ACE-Step-1.5
The most powerful local music generation model that outperforms almost all commercial alternatives, supporting Mac, AMD, Intel, and CUDA devices.
cupy / cupy
NumPy & SciPy for GPU
taskflow / taskflow
A General-purpose Task-parallel Programming System in C++
LMCache / LMCache
LMCache: Supercharge Your LLM with the Fastest KV Cache Layer
xlite-dev / LeetCUDA
An Open-source book with Modern CUDA learning Notes for Beginners - BF16/FP8/FP4, HGEMM, CuTe, Flash-Attention, etc.
numba / numba
NumPy aware dynamic Python compiler using LLVM
NVIDIA / cutlass
CUDA Templates and Python DSLs for High-Performance Linear Algebra
NVIDIA / cudf
cuDF - GPU DataFrame Library
replicate / cog
Containers for machine learning
catboost / catboost
A fast, scalable, high performance Gradient Boosting on Decision Trees library, used for ranking, classification, regression and other machine learning tasks for Python, R, Java, C++. Supports computation on CPU and GPU.
InternLM / lmdeploy
LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
XuehaiPan / nvitop
An interactive NVIDIA-GPU process viewer and beyond, the one-stop solution for GPU process management.
NVIDIA / warp
A Python framework for GPU-accelerated simulation, robotics, and machine learning.
flashinfer-ai / flashinfer
FlashInfer: Kernel Library for LLM Serving
gpustack / gpustack
A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.
shader-slang / slang
Making it easier to work with shaders
chrxh / alien
ALIEN is a CUDA-powered artificial life simulation program.
Rust-GPU / rust-cuda
Ecosystem of libraries and tools for writing and executing fast GPU code fully in Rust.
NVIDIA / cuml
NVIDIA cuML: GPU-Accelerated Machine Learning
NVIDIAGameWorks / kaolin
A PyTorch Library for Accelerating 3D Deep Learning Research
NVIDIA / nccl
Optimized primitives for collective multi-GPU communication
facebookincubator / AITemplate
AITemplate is a Python framework which renders neural network into high performance CUDA/HIP C++ code. Specialized for FP16 TensorCore (NVIDIA GPU) and MatrixCore (AMD GPU) inference.
OpenNMT / CTranslate2
Fast inference engine for Transformer models
NVlabs / tiny-cuda-nn
Lightning fast C++/CUDA neural network framework
ROCm / hip
HIP: C++ Heterogeneous-Compute Interface for Portability
iree-org / iree
A retargetable MLIR-based machine learning compiler and runtime toolkit.
MrNeRF / LichtFeld-Studio
Train, inspect, edit, automate, and export 3D Gaussian Splatting scenes from a single native application.
NVIDIA / cuda-rust
NVIDIA's CUDA platform for Rust. Host runtime crates plus Tile (cutile-rs) and SIMT (cuda-oxide) kernel programming models in idiomatic Rust.
NVIDIA / skills
Agent Skills for NVIDIA products โ install into Claude Code, Codex, and other coding agents to run Physical AI, robotics, simulation, CUDA, and RAG workflows end to end.
roflcoopter / viseron
Self-hosted, local only NVR and AI Computer Vision software. With features such as object detection, motion detection, face recognition and more, it gives you the power to keep an eye on your home, office or any other place you want to monitor.
NVIDIA / TransformerEngine
A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit and 4-bit floating point (FP8 and FP4) precision on Hopper, Ada and Blackwell GPUs, to provide better performance with lower memory utilization in both training and inference.
ashvardanian / StringZilla
Up to 100x faster strings for C, C++, CUDA, Python, Rust, Swift, JS, & Go, leveraging NEON, AVX2, AVX-512, SVE, GPGPU, & SWAR to accelerate search, hashing, sorting, edit distances, sketches, and memory ops ๐ฆ
patriciogonzalezvivo / lygia
LYGIA, it's a granular and multi-language (GLSL, HLSL, Metal, WGSL, WEGL and CUDA) shader library designed for performance and flexibility
NVIDIA / cuda-python
CUDA Python: Performance meets Productivity
BBuf / how-to-optim-algorithm-in-cuda
how to optimize some algorithm in cuda.
LeelaChessZero / lc0
Open source neural network chess engine with GPU acceleration and broad hardware support.
Jittor / jittor
Jittor is a high-performance deep learning framework based on JIT compiling and meta-operators.
Alexey-T / CudaText
Cross-platform text editor, written in Free Pascal
ForceInjection / AI-fundamentals
AI ๅบ็ก็ฅ่ฏ - GPU ๆถๆใCUDA ็ผ็จใๅคงๆจกๅๅบ็กๅAI Agent ็ธๅ ณ็ฅ่ฏใ
containers / ramalama
RamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and facilitates their use for inference in production, all through the familiar language of containers.
heavyai / heavydb
HeavyDB (formerly MapD/OmniSciDB)
pytorch / TensorRT
PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT
pytorch / ao
PyTorch native quantization for training and inference
Luce-Org / lucebox
LLM speculative inference server for heterogeneous hardware & consumer GPUs