yifanzhang-pro/recurrent-looped-tranformer

This repository is the official project page of Recurrent Looped Transformer (RLT), showing a new Transformer architecture. It achieves efficient recursive computation by passing the decoder hidden state between prompts and response tokens and combining sliding window attention. Mainly used for academic research, providing papers, codes and experimental results.