alibaba / rtp-llm

git clone https://github.com/alibaba/rtp-llm.git

RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.

stars, 24h · #12,023

+~7

stars, 7 days · #12,542

+~30

stars, 30 days · #17,899

1.4k

★ total · +1% this week

289

forks · 245 open issues

2026-10-20 · 1,365 ★ 2026-10-22 · 1,366 ★

LanguagePython

LicenseApache-2.0

Created2023-12-27 (2y ago)

Last pushtoday

OwnerOrganization