EvolvingLMMs-Lab / lmms-eval

git clone https://github.com/EvolvingLMMs-Lab/lmms-eval.git

One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks

—

stars, 24h

—

stars, 7 days

—

stars, 30 days

4.5k

★ total

676

forks · 63 open issues

Star history starts 2026-10-20; the chart appears after the second daily snapshot.

LanguagePython

License—

Created2024-03-07 (2y ago)

Last push3d ago

OwnerOrganization

GitHub topics

agi audio-evaluation benchmark evaluation large-language-models llm-evaluation multimodal multimodal-evaluation video-understanding vision-language-model vlm

Links

GitHub: github.com/EvolvingLMMs-Lab/lmms-eval
Homepage: https://www.lmms-lab.com
Releases · Issues · Hacker News mentions