mw00 / project-maya
Project Maya - run GLM-5.3-Flash (321B MoE) and DeepSeek-V4.1-Flash-1017 (748B MoE) privately on your own GPU(s), from one card to 16, NVIDIA or AMD, Linux or Windows. Engine, server, dashboard, OpenAI- and Anthropic-compatible API, quant tools.
antirez / ds4
DeepSeek 4 Flash and PRO local inference engine for Metal, CUDA and ROCm
lemonade-sdk / lemonade
Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk
LMCache / LMCache
LMCache: Supercharge Your LLM with the Fastest KV Cache Layer
tracel-ai / burn
Burn is a next generation tensor library and Deep Learning Framework that doesn't compromise on flexibility, efficiency and portability.
ROCm / FastFlowLM
Run LLMs on AMD Ryzen™ AI NPUs in minutes; purpose-built and deeply optimized for the AMD NPUs.
peonist-ai / halogen-flash-server
The fastest way to run Qwen3.8-Flash-Next on Strix Halo (gfx1151)
warpfront / hipfire
RDNA-native LLM inference engine in Rust.
gpustack / gpustack
A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.
Luce-Org / lucebox
LLM speculative inference server for heterogeneous hardware & consumer GPUs
SemiAnalysisAI / InferenceX
Open Source AI Accelerator Research Platform Standard / 开源推理研究平台
shawnshekari / strixite
LLM inference engine written from scratch in HIP for AMD Strix Halo (gfx1151) and Qwen3.8-Flash-Next - ~50 tokens/s out to 492k context
Motphys / UniLab
UniLab: A Heterogeneous Architecture for Robot RL Beyond GPU-Dominant Paradigms
ROCm / aiter
AI Tensor Engine for ROCm
countervolts / d4r
NVIDIA's official DLSS 3/4/4.5 on AMD RDNA3/4 GPUs on Windows and Linux.
stew675 / llama-cpp-rdna-boosts
A set of performant RDNA/HIP patches against llama.cpp focusing on high speed inferencing with numerics assurance
Dyluhn / R9V
Shape-specialized ROCm inference for Qwen3.8 Flash Next on RDNA4
ROCm / rocm-libraries
super repo for rocm libraries
apache / tvm
Open Machine Learning Compiler Framework
ROCm / hip
HIP: C++ Heterogeneous-Compute Interface for Portability
collabora / WhisperLive
A nearly-live implementation of OpenAI's Whisper.
pyrocms / pyrocms
Pyro is an experienced and powerful Laravel PHP CMS.
deepmodeling / deepmd-kit
A deep learning package for many-body potential energy representation and molecular dynamics
dphnAI / sonar
Large-scale LLM inference engine
ROCm / TheRock
The HIP Environment and ROCm Kit - A lightweight open source build system for HIP and ROCm
Brandon7CC / mac-monitor
"The missing ProcMon for macOS": Mac Monitor records Endpoint Security events and displays them for analysis.
ROCm / MIOpen
[DEPRECATED] Moved to ROCm/rocm-libraries repo
lemonade-sdk / llamacpp-rocm
Fresh builds of llama.cpp with AMD ROCm™ 7 acceleration
ROCm / HIPIFY
HIPIFY: Convert CUDA to Portable C++ Code
lablup / backend.ai
Backend.AI is a streamlined, container-based computing cluster platform that hosts popular computing/ML frameworks and diverse programming languages, with pluggable heterogeneous accelerator support including CUDA GPU, ROCm GPU, Gaudi NPU, Google TPU, GraphCore IPU and other NPUs.
hybridgroup / yzma
Go with your own intelligence - Write Go applications that directly integrate llama.cpp for local inference using hardware acceleration on Linux, macOS, Windows, & WebAssembly.
ROCm / composable_kernel
[DEPRECATED] Moved to ROCm/rocm-libraries repo. NOTE: develop branch is maintained as a read-only mirror
ROCm / rocm-systems
super repo for rocm systems projects
krrishnarraj / clpeak
Peak compute, memory bandwidth and latency of CPUs, GPUs and NPUs: the same tests through every API that reaches a device. Command line and app for Windows, macOS, Linux and Android
ROCm / ROCm-docker
Dockerfiles for the various software layers defined in the ROCm software platform
Speedstu / CUDA-for-AMD-Windows
Run CUDA-targeted Windows applications on AMD GPUs with ZLUDA + ROCm/HIP.
julianmb / q38rocm
Qwen 3.8 27B ROCmFP4 on AMD Strix Halo (Ryzen AI Max+ 395). Up to 36 tok/s via MTP Speculation, TurboQuant & Mesa RADV Wave64.
Nathanw1014 / strix-halo-llamacpp
Performance-tuned llama.cpp for AMD Strix Halo (gfx1151): FA + MoE-prefill fixes with a bundled current Mesa driver. Vulkan and HIP; portable dir, Docker, and distrobox.
Yamz-Labs / kyojin
Kyojin: the Yamz inference engine for AMD Strix Halo (ROCm, gfx1151), built on ExLlamaV3. Runs 300B-class MoE models on one 128 GB mini PC.
peonist-ai / halogen-server
The fastest way to run Qwen3.8 27B on Strix Halo (gfx1151)
IIIIIllllIIIIIlllll / Qwenox
An inference framework customized for AI MAX 395, compatible with both Linux and Windows, and supports deploying only qwen3.8-flash-next. This project is for reference and learning purposes only. 为AI MAX 395定制的推理框架，Linux和Windows通用，只能部署qwen3.8-flash-next。本项目仅供参考学习使用。
julianmb / halofpx
High-performance Lemonade alternative for AMD Strix Halo & Radeon — latest MoE models (Ling-3.0-Flash, Qwen 3.8 Flash Next, Ornith 1.5), bleeding-edge RDNA 3.5 Wave64/ROCmFP4 kernels, and silicon-tuned profiles.
pwilkin / strix-halo
Portable optimized ROCm and Qwen3.8-27B setup for AMD Strix Halo
kamil9966 / CAPEv2-Sandbox-plugin-Procmon-Events-v1
Расширение WebUI для CAPEv2: добавляет в обычный отчёт вкладку Procmon Events. Обеспечивает возможность реализовывать интерактивный просмотр, поиск и анализ событий созданных утилитой Microsoft Sysinternals Procmon в процессе детонации ВПО.
SlyBase / vllm-sly-radiance
Working on the fastest vllm path for AMD Radeon AI PRO R9700
ROCmFPX / ROCmFPX
This will be the official ROCmFPX stack and studio
hec-ovi / text-to-3D-skill
Local text to textured GLB on an AMD Strix Halo iGPU (gfx1151): FLUX.2 klein, a Vulkan-only TRELLIS.2 engine, and humanoid auto-rigging with SkinTokens on ROCm. No Blender, no CUDA.
ServeurpersoCom / yue2.cpp
Portable C++17 implementation of YuE2 AI Music Generator using GGML. Text + lyrics in, stereo 48kHz MP3 or WAV out. Runs on CPU, CUDA, ROCm, Metal, Vulkan.
Schaka / rocm-gfx803
ROCm for gfx803 aka RX 460, RX 470, RX 480, RX 550, RX 560, RX 570, RX 580 and RX 590 with custom patches, kernel fixes, etc
rulith-dev / rulith-inference
Rulith Inference, formerly Strix Llama. Serving a 125B MoE model fast on one AMD Strix Halo machine, on Windows: a patched llama.cpp, a manager, and a desktop app.
bkvargyas / r9700-stack
AMD R9700 Tuned Stack for vLLM and ROCM10
burrellka / MyStrixHaloSetup
A two-day, non-expert guide to running local LLMs on an AMD Strix Halo (Ryzen AI Max+ 395) box — full ~120GB memory pool, ROCm backend, NPU in parallel via FastFlowLM, one OpenAI-compatible endpoint.
eust-w / amd-bigym-3dgs-rocm
AMD Radeon ROCm reproduction of the DL3DV commercial-kitchen 3DGS shell for BiGym/MuJoCo, with verified W7900D artifacts.
otheru-ai / ember
DeepSeek-V4-Flash inference for AMD Strix Halo
infervisor / plow
Packet Language for On-device Warps — a GPU inference compiler and runtime
cupy / cupy
NumPy & SciPy for GPU
iree-org / iree
A retargetable MLIR-based machine learning compiler and runtime toolkit.
ServeurpersoCom / minimaxmusic.cpp
Portable C++17 implementation of MiniMax Music 3 AI Music Generator using GGML. Text + lyrics in, stereo 48kHz MP3 or WAV out. Runs on CPU, CUDA, ROCm, Metal, Vulkan.