Adagrad
Software / App
An optimization algorithm that modifies learning rates based on the sum of squared past gradients, discussed as a precursor to Adam.
Mentioned in 3 videos
Save the 3 videos on Adagrad to your own pod.
Sign up free to keep building your knowledge base on Adagrad as more episodes are added.
Videos Mentioning Adagrad
Stanford CS229 Machine Learning | Spring 2026 | Lecture 2: Supervised Learning Setup
Stanford Online
An adaptive optimization algorithm developed by John Duchi, used for selecting step sizes in machine learning.
Stanford CS336 Language Modeling from Scratch | Spring 2026 | Lecture 2: PyTorch (einops)
Stanford Online
An optimization algorithm that modifies learning rates based on the sum of squared past gradients, discussed as a precursor to Adam.
Stanford CS229 Machine Learning | Spring 2026 | Lecture 3: Weighted Least Squares
Stanford Online
An algorithm inspired by estimating curvature information, related to second-order methods and used in machine learning optimization.