NVIDIA Cutlass

Software / App

A library from NVIDIA that provides primitives for efficient matrix multiplication and memory loading on GPUs, used as a base for Flash Attention 2.

Mentioned in 1 video

Videos Mentioning NVIDIA Cutlass

FlashAttention-2: Making Transformers 800% faster AND exact

FlashAttention-2: Making Transformers 800% faster AND exact

Latent Space

A library from NVIDIA that provides primitives for efficient matrix multiplication and memory loading on GPUs, used as a base for Flash Attention 2.