Prasannajaga / deployment-guide

git clone https://github.com/Prasannajaga/deployment-guide.git

Deployment & experimentation of LLM inference at production scale (P/D disaggregation, KV offloading, parallelism, and autoscaling).