GPT-J
Software / AppMentioned in 2 videos
A large language model developed by EleutherAI; GPT-NeoX was mentioned as a bigger version of GPT-J, and its tokenizer was taken for early RWKV versions.
Videos Mentioning GPT-J
RWKV: Reinventing RNNs for the Transformer Era
Latent Space
A large language model developed by EleutherAI; GPT-NeoX was mentioned as a bigger version of GPT-J, and its tokenizer was taken for early RWKV versions.
FlashAttention-2: Making Transformers 800% faster AND exact
Latent Space
An open-source model mentioned as an example of valuable contributions to the AI community.