olewave / fa-bench

git clone https://github.com/olewave/fa-bench.git

Phone and word timestamp accuracy on human-labeled TIMIT and Buckeye, clean and under reverb, noise, music and babble. Two tracks, forced aligners given the transcript and ASR systems that find their own words. MFA, WhisperX, Charsiu, Qwen3, Parakeet-TDT, Olign and more. Monthly leaderboards, paper on arXiv.