MuLabPKU / TransArch

git clone https://github.com/MuLabPKU/TransArch.git

Design hardware-friendly model architectures and migrate existing LLMs with minimal performance loss

—

stars, 24h

—

stars, 7 days

—

stars, 30 days

513

★ total

35

forks · 20 open issues

Star history starts 2026-10-20; the chart appears after the second daily snapshot.

LanguagePython

License—

Created2025-01-02 (1y ago)

Last push2d ago

OwnerOrganization

GitHub topics

attention deepseek mla

Links

GitHub: github.com/MuLabPKU/TransArch
Homepage: https://arxiv.org/abs/2502.07864
Releases · Issues · Hacker News mentions