SoundsGoodAI / fast-gpu-asr

git clone https://github.com/SoundsGoodAI/fast-gpu-asr.git

High-throughput batched ASR for NVIDIA GPUs. Run Zipformer and NVIDIA NeMo Parakeet models through one Python API with TensorRT, custom CUDA plugins, GPU beam search, and word timestamps - up to 25,000 RTFx on B300.