SandAI-org / MagiAttention
git clone https://github.com/SandAI-org/MagiAttention.git
A Distributed Attention Towards Linear Scalability for Ultra-Long Context, Heterogeneous Data Training
+2
stars, 24h · #11,757
+~5
stars, 7 days · #20,049
+~20
stars, 30 days · #24,279
962
★ total · +1% this week
71
forks · 31 open issues
Star history (as recorded here)
LanguagePython
LicenseApache-2.0
Created2025-04-20 (1y ago)
Last pushtoday
OwnerOrganization