C-Reg

Concept

Sketch Isotropic Gaussian Regularizer, a technique used in LOVER model to prevent representation collapse by optimizing the distribution of embeddings to be isotropic Gaussian.

Mentioned in 1 video

Videos Mentioning C-Reg

Stanford CS25: Transformers United V6 I From Representation Learning to World Modeling

Stanford CS25: Transformers United V6 I From Representation Learning to World Modeling

Stanford Online

Sketch Isotropic Gaussian Regularizer, a technique used in LOVER model to prevent representation collapse by optimizing the distribution of embeddings to be isotropic Gaussian.