Gated DeltaNet
Software / App
A state space model or linear attention model that has become popular in recent years.
Mentioned in 2 videos
Save the 2 videos on Gated DeltaNet to your own pod.
Sign up free to keep building your knowledge base on Gated DeltaNet as more episodes are added.
Videos Mentioning Gated DeltaNet
Stanford CS336 Language Modeling from Scratch | Spring 2026 | Lecture 1: Overview, Tokenization
Stanford Online
A state space model or linear attention model that has become popular in recent years.
Stanford CS336 Language Modeling from Scratch | Spring 2026 | Lecture 4: Attention Alternatives
Stanford Online
A state space model that builds upon Mamba 2 by adding a second gate (beta T) to control updates and incorporates a projection for gate interactions.