R

RNNs

Software / AppMentioned in 1 video

Recurrent Neural Networks which, while less scalable than Transformers, could have potentially achieved ChatGPT-like results with web-scale pre-training.

Videos Mentioning RNNs

Information Theory for Language Models: Jack Morris

Information Theory for Language Models: Jack Morris

Latent Space

Recurrent Neural Networks which, while less scalable than Transformers, could have potentially achieved ChatGPT-like results with web-scale pre-training.