pegainfer-project / pegainfer

git clone https://github.com/pegainfer-project/pegainfer.git

Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2

stars, 24h · #6,105

+~14

stars, 7 days · #6,780

+~60

stars, 30 days · #8,561

724

★ total · +2% this week

120

forks · 67 open issues

2026-10-20 · 722 ★ 2026-10-22 · 724 ★

LanguageRust

LicenseApache-2.0

Created2026-02-17 (8mo ago)

Last push2d ago

OwnerOrganization