RMSprop

Concept

An optimization algorithm that uses an exponential moving average of squared gradients to adapt the learning rate for each parameter.

Mentioned in 1 video