embedding lookup / indexing

Software / App

The mechanism for turning integer token indices into embedded vectors; backward involves scattering and summing gradients into the embedding matrix rows used.

Mentioned in 1 video

Videos Mentioning embedding lookup / indexing

Building makemore Part 4: Becoming a Backprop Ninja

Andrej Karpathy

The mechanism for turning integer token indices into embedded vectors; backward involves scattering and summing gradients into the embedding matrix rows used.