GPT-2

Is RL a dead end? – Dario Amodei

Dwarkesh Clips

OpenAI language model demonstrating broader generalization from internet-scale data

Deep Dive into LLMs like ChatGPT

Andrej Karpathy

Imagining Education with Generative AI

MIT Open Learning

Information Theory for Language Models: Jack Morris

Latent Space

An OpenAI model that Jack Morris found interesting, though BERT was more popular at the time.

Scaling Test Time Compute to Multi-Agent Civilizations — Noam Brown, OpenAI

Latent Space

Mentioned as a model that likely would not have benefited from reasoning paradigms, highlighting the need for a certain baseline capability in models before applying techniques like chain-of-thought.