NVIDIA-NeMo / Switchyard

git clone https://github.com/NVIDIA-NeMo/Switchyard.git

Switchyard lets LLM applications route traffic across models and providers while preserving native OpenAI and Anthropic API compatibility - enabling flexible model selection, benchmarking, and cost/performance optimization.