contrastive divergence

Study / Research

A training method (used historically for RBMs) that was mentioned to illustrate earlier practices of computing/using gradients directly instead of autograd.

Mentioned in 1 video

Videos Mentioning contrastive divergence

Building makemore Part 4: Becoming a Backprop Ninja

Building makemore Part 4: Becoming a Backprop Ninja

Andrej Karpathy

A training method (used historically for RBMs) that was mentioned to illustrate earlier practices of computing/using gradients directly instead of autograd.