Positional Encoding

Concept

A method to inject information about the position of tokens in a sequence, crucial for Transformers.

Mentioned in 1 video

Videos Mentioning Positional Encoding

A Comprehensive Overview of Large Language Models - Latent Space Paper Club

A Comprehensive Overview of Large Language Models - Latent Space Paper Club

Latent Space

A method to inject information about the position of tokens in a sequence, crucial for Transformers.