jitllm / jitllm

git clone https://github.com/jitllm/jitllm.git

Smart inference engine that adapts to your hardware to run models faster, even when they don’t fit in memory