StreamEval / StreamEval
git clone https://github.com/StreamEval/StreamEval.git
Benchmark for evaluating interactive streaming video generation models across avatar, world, and video-editing tasks over 15-300 second sessions.
Why you might care
Use it to compare streaming video generators on how they handle live user requests and preserve context during generation, rather than on single-clip quality. Benchmark data, evaluation code, protocols, and scoring rules are fully open, with leaderboard results promised monthly. It covers five tasks and ten metrics, and ships a CPU example that needs no API key or GPU.
+62
stars, 24h · #689
+~381
stars, 7 days · #650
+418
stars, 30 days · #2,268
418
★ total · +381% this week
8
forks · 0 open issues
Star history (as recorded here)
LanguagePython
LicenseApache-2.0
Created2026-10-15 (12d ago)
Last push2d ago
Watchers1
OwnerUser
GitHub topics
avatar-performanceinteraction-streaming-videoreal-time-video-editingstreaming-video-generationvideo-generation-benchmark
Links
- GitHub: github.com/StreamEval/StreamEval
- Homepage: https://streameval.ai
- Releases · Issues · Hacker News mentions
README
Loading README…
Blurb generated by claude-haiku-5-5 today. Star deltas marked ~ are extrapolated from partial history.