Longformer

Software / App

A transformer-based language model designed to handle much longer sequences than standard BERT, which Michael Royzen utilized for its larger context window.

Mentioned in 1 video

Videos Mentioning Longformer

Beating GPT-4 with Open Source Models - with Michael Royzen of Phind

Beating GPT-4 with Open Source Models - with Michael Royzen of Phind

Latent Space

A transformer-based language model designed to handle much longer sequences than standard BERT, which Michael Royzen utilized for its larger context window.