AdaGrad

Concept

An optimization algorithm that adaptively scales the learning rate for each parameter based on the historical sum of squared gradients.

Mentioned in 1 video

Videos Mentioning AdaGrad

Foundations of Deep Learning (Hugo Larochelle, Twitter)

Foundations of Deep Learning (Hugo Larochelle, Twitter)

Lex Fridman

An optimization algorithm that adaptively scales the learning rate for each parameter based on the historical sum of squared gradients.