michaelfeil / infinity

git clone https://github.com/michaelfeil/infinity.git

Infinity is a high-throughput, low-latency serving engine for text-embeddings, reranking models, clip, clap and colpali