ai-dynamo / aisimulate

git clone https://github.com/ai-dynamo/aisimulate.git

AISimulate predicts LLM serving behavior and searches for strong deployment configurations offline, without bringing up a GPU serving cluster