Positional Encoding

A Comprehensive Overview of Large Language Models - Latent Space Paper Club

Latent Space

A method to inject information about the position of tokens in a sequence, crucial for Transformers.