flash attention

Software / AppMentioned in 1 video

An optimized implementation of transformer attention, which Manifest AI's Vidril framework can match or outperform, especially on non-standard problem shapes.

Videos Mentioning flash attention

⚡️ Beyond Transformers with Power Retention

Latent Space

An optimized implementation of transformer attention, which Manifest AI's Vidril framework can match or outperform, especially on non-standard problem shapes.