Adagrad
Software / App
An optimization algorithm that modifies learning rates based on the sum of squared past gradients, discussed as a precursor to Adam.
Mentioned in 2 videos
Save the 2 videos on Adagrad to your own pod.
Sign up free to keep building your knowledge base on Adagrad as more episodes are added.
Videos Mentioning Adagrad
Stanford CS336 Language Modeling from Scratch | Spring 2026 | Lecture 2: PyTorch (einops)
Stanford Online
An optimization algorithm that modifies learning rates based on the sum of squared past gradients, discussed as a precursor to Adam.
Stanford CS229 Machine Learning | Spring 2026 | Lecture 3: Weighted Least Squares
Stanford Online
An algorithm inspired by estimating curvature information, related to second-order methods and used in machine learning optimization.