dphnAI / sonar

git clone https://github.com/dphnAI/sonar.git

Large-scale LLM inference engine

—

stars, 24h

—

stars, 7 days

—

stars, 30 days

1.9k

★ total

211

forks · 55 open issues

Star history starts 2026-10-20; the chart appears after the second daily snapshot.

LanguagePython

LicenseAGPL-3.0

Created2023-06-23 (3y ago)

Last push2d ago

OwnerOrganization

GitHub topics

api-rest cuda inference-engine inferentia intel lora machine-learning rocm speculative-decoding tpu

Links

GitHub: github.com/dphnAI/sonar
Homepage: https://sonar.dphn.ai
Releases · Issues · Hacker News mentions