HBM3

FlashAttention-2: Making Transformers 800% faster AND exact

Latent Space

A newer iteration of High Bandwidth Memory, expected to be faster than HBM2.