Forward Mode Automatic Differentiation

Concept

A mode of automatic differentiation where gradients are computed forward through the computation graph, which is inefficient for machine learning with many parameters.

Mentioned in 1 video

Videos Mentioning Forward Mode Automatic Differentiation

Torch Tutorial (Alex Wiltschko, Twitter)

Torch Tutorial (Alex Wiltschko, Twitter)

Lex Fridman

A mode of automatic differentiation where gradients are computed forward through the computation graph, which is inefficient for machine learning with many parameters.