Stochastic Gradient Descent
Concept
A fundamental optimization algorithm that underpins many state-of-the-art deep learning results discussed in the video.
Mentioned in 3 videos
Save the 3 videos on Stochastic Gradient Descent to your own pod.
Sign up free to keep building your knowledge base on Stochastic Gradient Descent as more episodes are added.
Videos Mentioning Stochastic Gradient Descent
Deep Learning State of the Art (2019)
Lex Fridman
A fundamental optimization algorithm that underpins many state-of-the-art deep learning results discussed in the video.
Torch Tutorial (Alex Wiltschko, Twitter)
Lex Fridman
An iterative optimization algorithm used to find the minimum of an objective function, commonly used in training machine learning models.
Foundations of Deep Learning (Hugo Larochelle, Twitter)
Lex Fridman
The primary optimization algorithm used for training neural networks, involving iterative updates to parameters based on gradients computed from mini-batches of data.