:sunrise: A comprehensive, cutting-edge open-source framework for next-generation Transformers/LLM, with compute-matched benchmarking and a platform for autonomous architecture research.
FlashLoop: Fast and Memory-Efficient Looped Transformers via Lazy Updates