Luce-Org / lucebox
LLM speculative inference server for heterogeneous hardware & consumer GPUs
Luce-Org / lucebox
tsaipifong / whirl-llm
WHIRL (Windows HIP Inference for RDNA LLMs): native Windows C++/HIP LLM inference engine for the AMD Ryzen AI Max+ 395 (Radeon 8060S) and Radeon AI PRO R9700. Unzip and run, only the AMD driver.
GGZ14 / vllm-mxfp4
The fastest vLLM build for AMD R9700's. For the latest updates join the Launch80 discord server. I am on X now also https://x.com/bkuyper
magiccodingman / vllm-radiance
Codeberg fork of StillDeadcode / vllm-radiance which is a custom vllm tuned for R9700 GPU's
SlyBase / vllm-sly-radiance
Working on the fastest vllm path for AMD Radeon AI PRO R9700
bkvargyas / r9700-stack
AMD R9700 Tuned Stack for vLLM and ROCM10
charlie12345 / R9700AIProComfyUIPatch
An RDNA4 R9700 AI Pro ComfyUI patch for MiniMax H3 to speed up video generation.