Features Discover Use Cases Pricing Blog

Discover TopicsGradient Checking

Gradient Checking

1 video summary

Videos About Gradient Checking

Building makemore Part 4: Becoming a Backprop Ninja

Building makemore Part 4: Becoming a Backprop Ninja

Andrej Karpathy

Related Topics

Bessel Correction Manual Backprop Broadcasting Numerical Stability Embedding Lookup Tanh Activation Matrix Multiplication Gradients

Tools & Products

numerical stability trick: subtract max(logits)softmax / cross-entropy gradient (analytic formula)one-hot (F.one_hot)torch.zeros_like / torch.allclose PyTorch autograd (loss.backward)tanh (hyperbolic tangent)matrix multiplication gradients (A @ B rules)embedding lookup / indexing

Studies & Research

contrastive divergence Bessel's correction (divide by n-1)fragmented embeddings (2014 paper)Restricted Boltzmann Machines (RBMs)

Summify

Capture knowledge from anything you watch, read, or say.

Product

Pricing
Discover
Blog
Affiliate Program

Features

Summarize YouTube
Transcribe YouTube
Translate YouTube
PDF Summarizer
Voice Notes
AI Chat

Legal

Terms of Service
Privacy Policy

Contact

Contact Us
contact@summify.io

© 2026 Betastate Ltd. All rights reserved.