vdev-ctrl / Adaptive-Learnable-Hierarchical-Routing-
git clone https://github.com/vdev-ctrl/Adaptive-Learnable-Hierarchical-Routing-.git
This repo is a alternative solution for standard self-attention. It uses tree routing with learnable functions for cheaper self-attention while not compromising accuracy.
—
stars, 24h
—
stars, 7 days
+39
stars, 30 days · #7,383
39
★ total
4
forks · 0 open issues
Star history starts 2026-10-20; the chart appears after the second daily snapshot.
LanguagePython
LicenseApache-2.0
Created2026-10-08 (12d ago)
Last push9d ago
OwnerUser
GitHub topics
attention-mechanismdeep-learningefficient-inferenceefficient-transformersllmlong-contextpytorchsparse-attentionsub-quadratic-attentiontransformertree-attention