Build a system, load it until it breaks, and watch why. A system design simulator for learning distributed systems.
大模型推理案头手册(开源版):给定 GPU 算力,一个模型能扛多少 QPS?三层模型 × 三面墙 × 排队论 × 开环压测
Build a system, load it until it breaks, and watch why. A system design simulator for learning distributed systems.
大模型推理案头手册(开源版):给定 GPU 算力,一个模型能扛多少 QPS?三层模型 × 三面墙 × 排队论 × 开环压测