Logit-Normal Distribution

Concept

A distribution used to sample time steps for training, emphasizing middle noise levels more than early or late steps, improving model learning efficiency for hard tasks.

Mentioned in 1 video