GPT-J
Software / App
A large language model developed by EleutherAI; GPT-NeoX was mentioned as a bigger version of GPT-J, and its tokenizer was taken for early RWKV versions.
Mentioned in 3 videos
Save the 3 videos on GPT-J to your own pod.
Sign up free to keep building your knowledge base on GPT-J as more episodes are added.
Videos Mentioning GPT-J
RWKV: Reinventing RNNs for the Transformer Era
Latent Space
A large language model developed by EleutherAI; GPT-NeoX was mentioned as a bigger version of GPT-J, and its tokenizer was taken for early RWKV versions.
FlashAttention-2: Making Transformers 800% faster AND exact
Latent Space
An open-source model mentioned as an example of valuable contributions to the AI community.
Stanford CS329A Self-Improving AI Agents | Part 6 | Train Time Scaling/Scaling RL
Stanford Online
A 6 billion parameter open-source model based on GPT-3, used for experiments with the STAR approach.