Flash Attention

Concept

A technique for optimizing attention mechanisms in transformers, which impressed Alex Zhang.

Mentioned in 1 video

Videos Mentioning Flash Attention

Recursive Language Models — Alex Zhang, MIT PhD

Recursive Language Models — Alex Zhang, MIT PhD

Latent Space

A technique for optimizing attention mechanisms in transformers, which impressed Alex Zhang.