Bas
Study / Research
A model from early 2023 that combined a principled version of linear attention with a sliding window, pushing the frontier of data recall.
Mentioned in 1 video
A model from early 2023 that combined a principled version of linear attention with a sliding window, pushing the frontier of data recall.
![2024 in Post-Transformer Architectures: State Space Models, RWKV [Latent Space LIVE! @ NeurIPS 2024]](https://i.ytimg.com/vi/LPe6iC73lrc/maxresdefault.jpg)