GPT-2
2019 text-generating large language model
What podcasters actually say about GPT-2.
43 mentions, no marketing. Save them all to a pod and ask any question.
Common Themes
Videos Mentioning GPT-2
Why OpenAI's o1 Is A Huge Deal | YC Decoded
Y Combinator
An earlier OpenAI model benchmark that current o1 models are compared to, with an expected leap to GPT-4 stage.
How Scaling Laws Will Determine AI's Future | YC Decoded
Y Combinator
An early large language model released by OpenAI, notable for its size at the time and as a precursor to GPT-3.
AI Expert Warns: “This Is The Last Mistake We’ll Ever Make” - Tristan Harris
Chris Williamson
An early AI model that could barely finish a sentence coherently.
Anthropic’s $30B Ramp, Mythos Doomsday, OpenClaw Ankled, Iran War Ceasefire, Israel's Influence
All-In Podcast
A previous OpenAI model (1.5 billion parameters) that was similarly presented as potentially dangerous in 2019, but ultimately became a 'nothing burger'.
Stanford CS336 Language Modeling from Scratch | Spring 2026 | Lecture 1: Overview, Tokenization
Stanford Online
A scaled-up version of GPT, mentioned as an early example of large language model scaling.
How to Build Discipline in a Distracted World
Cal Newport
An early version of OpenAI's language model that contributed to the company's scaling.
Is AI About to Automate Every Office Job? (Not a Chance)
Cal Newport
Previous AI model mentioned as a point of comparison for the pace of improvement in LLMs.
Is AI About to “Eat Everything”? (It’s Not.)
Cal Newport
An early large language model in the progression of models, existing before the significant jumps in capability seen in later models.
Stanford CS336 Language Modeling from Scratch | Spring 2026 | Lecture 13: Data (Sources, Datasets)
Stanford Online
The model that sought high-quality web content by filtering pages linked from Reddit posts with high karma, using 40GB of text.
Stanford CS336 Language Modeling from Scratch | Spring 2026 | Guest Lecture: Dan Fu
Stanford Online
An earlier large language model that was considered too dangerous to release.
The Collapse of American Politics - Ezra Klein
Chris Williamson
An early generative AI model developed by OpenAI, marking the speaker's initial engagement with AI development.
Poolside’s Model Factory, Laguna S, Open Models, and the Race to AGI — Eiso Kant, Poolside AI
Latent Space
OpenAI's model, whose initial release was controversial due to fears of misuse, used as an example of past overestimations of danger.
Stanford MS&E435 Economics of the AI Supercycle | Spring 2026 | The GPU Economy
Stanford Online
An older model from OpenAI, used as a benchmark to illustrate the exponential increase in compute power and capabilities since its development.
The Real Story Behind OpenAI’s “Rogue” Model
Cal Newport
An earlier language model that marked the beginning of LLMs rapidly changing the cybersecurity landscape.
Stanford CS229 Machine Learning | Spring 2026 | Lecture 4: Exponential Family, GLMs Classification
Stanford Online
Mentioned as an example of an AI model with a specific dimensionality (768) relevant to the discussion on high-dimensional data separation.
Stanford CS329A Self-Improving AI Agents | Part 8 | Agentic Evaluations and Long Horizon Tasks
Stanford Online
Mentioned as an older model from 2019, which could only handle tasks around 2 seconds long with 50% success rate.
Chelsea Finn: This is the State of the Art in Robotics
Y Combinator
An early generalist model that marked a transition towards using models out-of-the-box without fine-tuning.
The Man Who Calls BS On AI: They’re LYING About AI, 2027 Is When It All Breaks! | Ed Zitron
The Diary Of A CEO
An OpenAI model that Dario Amodei (while at OpenAI) claimed was 'too scary to release,' illustrating a history of scare tactics from AI leaders.
Why The Harness Matters More Than The Model | YC Paper Club
Y Combinator
The initial version of the GPT model, used as an example for the earliest form of a test harness in February 2019.