InternLM / lmdeploy

git clone https://github.com/InternLM/lmdeploy.git

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

—

stars, 24h

—

stars, 7 days

—

stars, 30 days

8.1k

★ total

773

forks · 618 open issues

Star history starts 2026-10-20; the chart appears after the second daily snapshot.

LanguagePython

LicenseApache-2.0

Created2023-06-15 (3y ago)

Last pushtoday

OwnerOrganization

GitHub topics

codellama cuda-kernels deepspeed fastertransformer internlm llama llama2 llama3 llm llm-inference turbomind

Links

GitHub: github.com/InternLM/lmdeploy
Homepage: https://lmdeploy.readthedocs.io/en/latest
Releases · Issues · Hacker News mentions