JN's Easy Context

Software / App

A PyTorch implementation of ring attention that worked well and was adapted by Gradient for their cluster network topology.

Mentioned in 1 video

Videos Mentioning JN's Easy Context

How to train a Million Context LLM — with Mark Huang of Gradient.ai

How to train a Million Context LLM — with Mark Huang of Gradient.ai

Latent Space

A PyTorch implementation of ring attention that worked well and was adapted by Gradient for their cluster network topology.