triton-inference-server / model_analyzer

git clone https://github.com/triton-inference-server/model_analyzer.git

Triton Model Analyzer is a CLI tool to help with better understanding of the compute and memory requirements of the Triton Inference Server models.