Attention Free Transformer

RWKV: Reinventing RNNs for the Transformer Era

Latent Space

A paper written by Apple researchers, which blink, the creator of RWKV, adapted to scale up language models without traditional attention mechanisms.