RWKV
A type of state-space model that is being rolled out in Windows, contributing to the trend of on-device AI and alternative model architectures.
Save the 4 videos on RWKV to your own pod.
Sign up free to keep building your knowledge base on RWKV as more episodes are added.
Videos Mentioning RWKV
2024 Year in Review: The Big Scaling Debate, the Four Wars of AI, Top Themes and the Rise of Agents
Latent Space
A type of state-space model that is being rolled out in Windows, contributing to the trend of on-device AI and alternative model architectures.
![2024 in Post-Transformer Architectures: State Space Models, RWKV [Latent Space LIVE! @ NeurIPS 2024]](https://i.ytimg.com/vi/LPe6iC73lrc/maxresdefault.jpg)
2024 in Post-Transformer Architectures: State Space Models, RWKV [Latent Space LIVE! @ NeurIPS 2024]
Latent Space
An open-source architecture aiming to be accessible and efficient, developed through community efforts, contrasting with academic-led state-space models.
FlashAttention-2: Making Transformers 800% faster AND exact
Latent Space
An alternative Recurrent Neural Network architecture being explored as a successor to Transformers.
A Worm With 302 Neurons Inspired Their Architecture — Ramin Hasani, Liquid AI
Latent Space
A non-transformer architecture inspired by RNNs, discussed as another popular alternative in the AI landscape.