DCLM

Stanford CS336 Language Modeling from Scratch | Spring 2026 | Lecture 3: Architectures

Stanford Online

Mentioned as a model using the Z-loss trick for stabilizing output softmaxes.