Layer Normalization

A Comprehensive Overview of Large Language Models - Latent Space Paper Club

Latent Space

A technique used in deep learning to stabilize training by normalizing the inputs to a layer.