Attention mechanisms

Concept

Described as a brilliant mechanism and idea, built upon RNNs, that has shown promise at scale and is a significant development in AI.

Mentioned in 1 video