Osmantic / ODS
ODS V3 Pre-Release: Public testing and refinement ahead of the official V3 launch. Turn your PC, Mac, or Linux box into a private AI server.
Osmantic / ODS
Luce-Org / lucebox
LLM speculative inference server for heterogeneous hardware & consumer GPUs
kyuz0 / amd-strix-halo-toolboxes
—
peonist-ai / halogen-flash-server
The fastest way to run Qwen3.8-Flash-Next on Strix Halo (gfx1151)
Soulmate-Halo / heterogeneous-gpu-pd-lab
使用稠密算力卡对稀疏大显存主机进行加速，主机包括 AI Max+ 395、M3 512G、DGX Spark 等。
gufo-org / gufo
The Open Source Strix Halo AI engine. Qwen 3.8 Flash Next Q4_K_XL: 1,801.01 pp, 73.17 tg single user, 194.37 tok/s 8 users; Qwen 3.8 27B Q4_K_XL: 656.33pp, 70.56tg tok/s single user with DFlash2
kyuz0 / amd-strix-halo-vllm-toolboxes
—
julianmb / q38rocm
Qwen 3.8 27B ROCmFP4 on AMD Strix Halo (Ryzen AI Max+ 395). Up to 36 tok/s via MTP Speculation, TurboQuant & Mesa RADV Wave64.
Nathanw1014 / strix-halo-llamacpp
Performance-tuned llama.cpp for AMD Strix Halo (gfx1151): FA + MoE-prefill fixes with a bundled current Mesa driver. Vulkan and HIP; portable dir, Docker, and distrobox.
Yamz-Labs / kyojin
Kyojin: the Yamz inference engine for AMD Strix Halo (ROCm, gfx1151), built on ExLlamaV3. Runs 300B-class MoE models on one 128 GB mini PC.
peonist-ai / halogen-server
The fastest way to run Qwen3.8 27B on Strix Halo (gfx1151)
IIIIIllllIIIIIlllll / Qwenox
An inference framework customized for AI MAX 395, compatible with both Linux and Windows, and supports deploying only qwen3.8-flash-next. This project is for reference and learning purposes only. 为AI MAX 395定制的推理框架，Linux和Windows通用，只能部署qwen3.8-flash-next。本项目仅供参考学习使用。
julianmb / halofpx
High-performance Lemonade alternative for AMD Strix Halo & Radeon — latest MoE models (Ling-3.0-Flash, Qwen 3.8 Flash Next, Ornith 1.5), bleeding-edge RDNA 3.5 Wave64/ROCmFP4 kernels, and silicon-tuned profiles.
pwilkin / strix-halo
Portable optimized ROCm and Qwen3.8-27B setup for AMD Strix Halo
shawnshekari / strixite
LLM inference engine written from scratch in HIP for AMD Strix Halo (gfx1151) and Qwen3.8-Flash-Next - ~50 tokens/s out to 492k context
hec-ovi / text-to-3D-skill
Local text to textured GLB on an AMD Strix Halo iGPU (gfx1151): FLUX.2 klein, a Vulkan-only TRELLIS.2 engine, and humanoid auto-rigging with SkinTokens on ROCm. No Blender, no CUDA.
rulith-dev / rulith-inference
Rulith Inference, formerly Strix Llama. Serving a 125B MoE model fast on one AMD Strix Halo machine, on Windows: a patched llama.cpp, a manager, and a desktop app.
burrellka / MyStrixHaloSetup
A two-day, non-expert guide to running local LLMs on an AMD Strix Halo (Ryzen AI Max+ 395) box — full ~120GB memory pool, ROCm backend, NPU in parallel via FastFlowLM, one OpenAI-compatible endpoint.
tsaipifong / whirl-llm
WHIRL (Windows HIP Inference for RDNA LLMs): native Windows C++/HIP LLM inference engine for the AMD Ryzen AI Max+ 395 (Radeon 8060S) and Radeon AI PRO R9700. Unzip and run, only the AMD driver.
aic0d3r / qwen38-strix-halo-harness
Local AI coding agent harness for AMD Strix Halo (Ryzen AI Max+ 395): Qwen3.8 125B on the iGPU, NPU side-jobs, crash recovery, logged benchmarks. Works with any OpenAI-compatible engine; cloud optional.
otheru-ai / ember
DeepSeek-V4-Flash inference for AMD Strix Halo
julianmb / haloq38flash
qwen3.8-flash-next on strix halo — 91g quant, 56 tok/s, 262k context, receipts included