GPY-NeoX

RWKV: Reinventing RNNs for the Transformer Era

Latent Space

A large language model; RWKV was benchmarked against it and showed similar training performance.