GPT-3
2020 transformer-based large language model
Common Themes
Videos Mentioning GPT-3
Eliezer Yudkowsky: Dangers of AI and the End of Human Civilization | Lex Fridman Podcast #368
Lex Fridman
A predecessor to GPT-4, mentioned in a thought experiment about removing consciousness discussions from training data. It was also noted for being well-calibrated with probabilities before reinforcement learning with human feedback (RLHF) degraded this ability.
The Digital Multiverse: A Conversation with David Auerbach (Episode #319)
Sam Harris
A previous version of a large language model mentioned in Auerbach's book.
Noam Brown: AI vs Humans in Poker and Games of Strategic Negotiation | Lex Fridman Podcast #344
Lex Fridman
A large language model that, along with GPT-2, underscored the rapid advancements in AI, providing context for the ambitious goals of the Diplomacy AI project.
Balaji Srinivasan: How to Fix Government, Twitter, Science, and the FDA | Lex Fridman Podcast #331
Lex Fridman
Cited as an example of serious step-ups in AI capabilities.
Alien Debate: Sara Walker and Lee Cronin | Lex Fridman Podcast #279
Lex Fridman
A large language model, discussed as an example of AI that is improving at 'fooling' humans but is limited by its resource-constrained substrate and inability to generate true novelty or cross-domain connections.
Scott Aaronson: Computational Complexity and Consciousness | Lex Fridman Podcast #130
Lex Fridman
A large language model developed by OpenAI, noted for its impressive capability to generate human-like text, poems, and essays, but still having limitations in logical reasoning and arithmetic.
AI and the Future of Law: The 10 Year "Overnight" Success Story
Y Combinator
A large language model from OpenAI that CaseText utilized, enabling them to develop their core product, Co-Counsel.
How Scaling Laws Will Determine AI's Future | YC Decoded
Y Combinator
A successor to GPT-2, significantly larger and more capable, marking a pivotal moment in the era of scaling laws for LLMs.
AI Startup Founders Debate the Creation of Artificial General Intelligence
Y Combinator
Mentioned as an earlier example where one speaker already thought it was AGI.