ai-dynamo / aiperf

git clone https://github.com/ai-dynamo/aiperf.git

AIPerf is a comprehensive benchmarking tool that measures the performance of generative AI models served by your preferred inference solution.