Features Discover Use Cases Pricing Blog

Discover TopicsManual Backprop

Manual Backprop

1 video summary

Videos About Manual Backprop

Building makemore Part 4: Becoming a Backprop Ninja

Building makemore Part 4: Becoming a Backprop Ninja

Andrej Karpathy

Related Topics

Gradient Checking Broadcasting Numerical Stability Embedding Lookup Tanh Activation Matrix Multiplication Gradients Bessel Correction

Tools & Products

numerical stability trick: subtract max(logits)softmax / cross-entropy gradient (analytic formula)one-hot (F.one_hot)torch.zeros_like / torch.allclose PyTorch autograd (loss.backward)tanh (hyperbolic tangent)matrix multiplication gradients (A @ B rules)embedding lookup / indexing

Studies & Research

contrastive divergence Bessel's correction (divide by n-1)fragmented embeddings (2014 paper)Restricted Boltzmann Machines (RBMs)

Summify

Capture knowledge from anything you watch, read, or say.

Product

Pricing
Discover
Blog
Affiliate Program

Features

Summarize YouTube
Transcribe YouTube
Translate YouTube
PDF Summarizer
Voice Notes
AI Chat

Legal

Terms of Service
Privacy Policy

Contact

Contact Us
contact@summify.io

© 2026 Betastate Ltd. All rights reserved.