sharkdp / hyperfine

A command-line benchmarking tool

NVIDIA-NeMo / Switchyard

Switchyard lets LLM applications route traffic across models and providers while preserving native OpenAI and Anthropic API compatibility - enabling flexible model selection, benchmarking, and cost/performance optimization.

bencherdev / bencher

🐰 Bencher - Continuous Benchmarking