RWKV
Software / App
A type of state-space model that is being rolled out in Windows, contributing to the trend of on-device AI and alternative model architectures.
Mentioned in 3 videos
Videos Mentioning RWKV
2024 Year in Review: The Big Scaling Debate, the Four Wars of AI, Top Themes and the Rise of Agents
Latent Space
A type of state-space model that is being rolled out in Windows, contributing to the trend of on-device AI and alternative model architectures.
![2024 in Post-Transformer Architectures: State Space Models, RWKV [Latent Space LIVE! @ NeurIPS 2024]](https://i.ytimg.com/vi/LPe6iC73lrc/maxresdefault.jpg)
2024 in Post-Transformer Architectures: State Space Models, RWKV [Latent Space LIVE! @ NeurIPS 2024]
Latent Space
An open-source architecture aiming to be accessible and efficient, developed through community efforts, contrasting with academic-led state-space models.
FlashAttention-2: Making Transformers 800% faster AND exact
Latent Space
An alternative Recurrent Neural Network architecture being explored as a successor to Transformers.