Axial RoPE

Concept

A 2D position embedding strategy that segregates axes, representing vectors according to their coordinates in X and Y parts of the vector, used in the original DiT paper.

Mentioned in 1 video