matrix multiplication gradients (A @ B rules)

Tool / ProductMentioned in 1 video

The standard backward relationships for D = A @ B + C (dA = dD @ B.T, dB = A.T @ dD, dC = sum(dD)), derived by hand from small examples.

Videos Mentioning matrix multiplication gradients (A @ B rules)

Building makemore Part 4: Becoming a Backprop Ninja

Building makemore Part 4: Becoming a Backprop Ninja

Andrej Karpathy

The standard backward relationships for D = A @ B + C (dA = dD @ B.T, dB = A.T @ dD, dC = sum(dD)), derived by hand from small examples.