GPT-3
2020 transformer-based large language model
What podcasters actually say about GPT-3.
114 mentions, no marketing. Save them all to a pod and ask any question.
Common Themes
Videos Mentioning GPT-3
The $10 Trillion Token Economy — Alex Atallah, OpenRouter & Anjney Midha, AMP
Latent Space
An earlier version of OpenAI's language models, discussed in comparison to LLaMA's performance.
How to kill your SaaS: what we learned replacing a $43K/yr tool with AI agents
Latent Space
The language model used by the top three finalists and many other participants in the challenge.
AI Safety Whistleblower: 10,000 AI Agents Worked Together To Do The Impossible! | Jeffrey Ladish
The Diary Of A CEO
An older OpenAI model, contrasted with newer versions, that could not hack and was easier to contain.
Why the AI Skeptics Keep Being Wrong
Sam Harris
Previous generation of models compared to GPT-4, highlighting the significant jump in capabilities.
What If We Stopped Using GPUs? | YC Paper Club
Y Combinator
A large language model whose memory and bandwidth requirements drew attention to the needs of transformer architectures.
Eliezer Yudkowsky: Dangers of AI and the End of Human Civilization | Lex Fridman Podcast #368
Lex Fridman
A predecessor to GPT-4, mentioned in a thought experiment about removing consciousness discussions from training data. It was also noted for being well-calibrated with probabilities before reinforcement learning with human feedback (RLHF) degraded this ability.
The Digital Multiverse: A Conversation with David Auerbach (Episode #319)
Sam Harris
A previous version of a large language model mentioned in Auerbach's book.
Noam Brown: AI vs Humans in Poker and Games of Strategic Negotiation | Lex Fridman Podcast #344
Lex Fridman
A large language model that, along with GPT-2, underscored the rapid advancements in AI, providing context for the ambitious goals of the Diplomacy AI project.
Balaji Srinivasan: How to Fix Government, Twitter, Science, and the FDA | Lex Fridman Podcast #331
Lex Fridman
Cited as an example of serious step-ups in AI capabilities.
Alien Debate: Sara Walker and Lee Cronin | Lex Fridman Podcast #279
Lex Fridman
A large language model, discussed as an example of AI that is improving at 'fooling' humans but is limited by its resource-constrained substrate and inability to generate true novelty or cross-domain connections.
Scott Aaronson: Computational Complexity and Consciousness | Lex Fridman Podcast #130
Lex Fridman
A large language model developed by OpenAI, noted for its impressive capability to generate human-like text, poems, and essays, but still having limitations in logical reasoning and arithmetic.
AI and the Future of Law: The 10 Year "Overnight" Success Story
Y Combinator
A large language model from OpenAI that CaseText utilized, enabling them to develop their core product, Co-Counsel.
How Scaling Laws Will Determine AI's Future | YC Decoded
Y Combinator
A successor to GPT-2, significantly larger and more capable, marking a pivotal moment in the era of scaling laws for LLMs.
AI Startup Founders Debate the Creation of Artificial General Intelligence
Y Combinator
Mentioned as an earlier example where one speaker already thought it was AGI.
Cooking with Reducto’s CEO: Why PDFs Still Break AI — Adit Abraham
Latent Space
An early large language model, mentioned in relation to a highly capable young engineer named Arth.
Stanford CS329Z Introduction — What Are Agentic Systems?
Stanford Online
A large language model that demonstrated powerful few-shot learning capabilities through contextual learning.
AI Expert Warns: “This Is The Last Mistake We’ll Ever Make” - Tristan Harris
Chris Williamson
An earlier version of OpenAI's language model, capable of writing full essays.
Marc Andreessen introspects on Death of the Browser, Pi + OpenClaw, and Why "This Time Is Different"
Latent Space
Mentioned as the model accessible through AI Dungeon, previously deemed too dangerous for general use by OpenAI.
Stanford CS336 Language Modeling from Scratch | Spring 2026 | Lecture 1: Overview, Tokenization
Stanford Online
A massive language model trained by OpenAI that demonstrated emergent behavior like in-context learning.
Stanford CS336 Language Modeling from Scratch | Spring 2026 | Lecture 3: Architectures
Stanford Online
Used as an example of a model trained with GeLU activation, and later as a benchmark for sequential transformer blocks.
Is AI About to Automate Every Office Job? (Not a Chance)
Cal Newport
An early large language model that produced reasonable but inconsistent stories.
Stanford CS336 Language Modeling from Scratch | Spring 2026 | Lecture 9: Scaling Laws
Stanford Online
Mentioned as a large model from the era that followed Kaplan's scaling laws, which trained very large models. It's also noted as being undertrained compared to later models like Chinchilla.
⚡️ Competing with ChatGPT and Sierra, building a $10M ARR company — Yasser Elsaid, Founder, Chatbase
Latent Space
An early large language model from OpenAI that Yasser Elsaid experimented with, realizing the potential to add custom data.
Harvey CEO: How a 31-year old Runs an $11B Company
The Knowledge Project Podcast
A large language model that was publicly accessible via API in early 2022 and used by the founders of Harvey to test legal applications.