vdev-ctrl / Adaptive-Learnable-Hierarchical-Routing-

This repo is a alternative solution for standard self-attention. It uses tree routing with learnable functions for cheaper self-attention while not compromising accuracy.