Adam

Foundations of Deep Learning (Hugo Larochelle, Twitter)

Lex Fridman

A popular optimization algorithm that combines the benefits of momentum and RMSprop, often yielding good results with adaptive learning rates.