Stochastic Gradient Descent

Concept

A fundamental optimization algorithm that underpins many state-of-the-art deep learning results discussed in the video.

Mentioned in 3 videos

Videos Mentioning Stochastic Gradient Descent

Deep Learning State of the Art (2019)

Deep Learning State of the Art (2019)

Lex Fridman

A fundamental optimization algorithm that underpins many state-of-the-art deep learning results discussed in the video.

Torch Tutorial (Alex Wiltschko, Twitter)

Torch Tutorial (Alex Wiltschko, Twitter)

Lex Fridman

An iterative optimization algorithm used to find the minimum of an objective function, commonly used in training machine learning models.

Foundations of Deep Learning (Hugo Larochelle, Twitter)

Foundations of Deep Learning (Hugo Larochelle, Twitter)

Lex Fridman

The primary optimization algorithm used for training neural networks, involving iterative updates to parameters based on gradients computed from mini-batches of data.