RM Norm

Concept

A simpler normalization technique that omits subtracting the mean, focusing only on division by standard deviation, with tunable parameters.

Mentioned in 1 video

Videos Mentioning RM Norm

Stanford CS229 Machine Learning | Spring 2026 | Lecture 7: Neural Networks 1 (Architecture)

Stanford CS229 Machine Learning | Spring 2026 | Lecture 7: Neural Networks 1 (Architecture)

Stanford Online

A simpler normalization technique that omits subtracting the mean, focusing only on division by standard deviation, with tunable parameters.