jitllm / jitllm

Smart inference engine that adapts to your hardware to run models faster, even when they don’t fit in memory