Finite Differences

Torch Tutorial (Alex Wiltschko, Twitter)

Lex Fridman

A numerical method for approximating derivatives by perturbing inputs and measuring output changes; considered unstable and less accurate than automatic differentiation for machine learning.