embeddings-benchmark / mteb

MTEB: State-of-the-art evaluation of embeddings across languages and modalities

embeddings-benchmark / embedders-dilemma

Code, datasets, and results for "The Embedder's Dilemma: LLMs Are Better, but at What Cost?" (COLM 2026). MTEB(LLM) benchmarks 10 LLMs and 26 embedding models on 37 tasks with full cost and throughput accounting.