AkiYangDev / mini-deepinfer
git clone https://github.com/AkiYangDev/mini-deepinfer.git
Learn DeepInfer through a small, runnable inference engine. Follow the code on CPU, then run real Qwen3.5 models on Ascend 910C.
—
stars, 24h
+25
stars, 7 days · #7,949
+25
stars, 30 days · #24,134
25
★ total · +25% this week
0
forks · 0 open issues
Star history starts 2026-10-26; the chart appears after the second daily snapshot.
LanguagePython
LicenseApache-2.0
Created2026-10-20 (6d ago)
Last push1d ago
OwnerUser
GitHub topics
ascendascend-910ccontinuous-batchingdeepinferdeepseekeducationalinference-enginekv-cachellm-inferencepytorchqwen3-5speculative-decoding
Links
README
Loading README…