lightseekorg / tokenspeed

TokenSpeed is an LLM inference engine built for agentic workloads, with a C++ scheduler control plane and Python execution plane.

MaincodeHQ / mainarch

A from-scratch Rust inference stack for AMD GPUs that talks straight to the Linux kernel driver. No ROCm, HIP, or HSA runtime. Serves OLMo 2 on MI355X.