embedding lookup / indexing

Tool / ProductMentioned in 1 video

The mechanism for turning integer token indices into embedded vectors; backward involves scattering and summing gradients into the embedding matrix rows used.

Videos Mentioning embedding lookup / indexing

Building makemore Part 4: Becoming a Backprop Ninja

Andrej Karpathy

The mechanism for turning integer token indices into embedded vectors; backward involves scattering and summing gradients into the embedding matrix rows used.