Atlas-Inf / atlas

git clone https://github.com/Atlas-Inf/atlas.git

Atlas Inference is a dependency free lightweight inference engine meant to run LLMs on YOUR compute seamlessly. Supports GB10 and Strix Halo at the moment, hoping to expand to more!