Ring Attention

Software / App

A technique employed by Gradient for training their long context models, improving GPU utilization.

Mentioned in 1 video

Videos Mentioning Ring Attention

How to train a Million Context LLM — with Mark Huang of Gradient.ai

How to train a Million Context LLM — with Mark Huang of Gradient.ai

Latent Space

A technique employed by Gradient for training their long context models, improving GPU utilization.