Transfer Learning
A technology that helps AI work with small data sets, crucial for industries outside of consumer internet.
Common Themes
Videos Mentioning Transfer Learning
A Comprehensive Overview of Large Language Models - Latent Space Paper Club
Latent Space
A machine learning technique where a model trained on one task is repurposed for a second related task.
Dmitry Korkin: Evolution of Proteins, Viruses, Life, and AI | Lex Fridman Podcast #153
Lex Fridman
A machine learning technique where knowledge gained from one task is applied to another, showing promise for predicting viral pathogenicity.
Juergen Schmidhuber: Godel Machines, Meta-Learning, and LSTMs | Lex Fridman Podcast #11
Lex Fridman
A machine learning technique where a network trained on one task is reused or adapted for a different, related task. Schmidhuber differentiates this from true meta-learning, noting it's a more basic form achieved by retraining the top layers of a pre-trained network.
Jeremy Howard: fast.ai Deep Learning Courses and Research | Lex Fridman Podcast #35
Lex Fridman
A critical technique highlighted by Jeremy Howard for deep learning that allows achieving state-of-the-art results with orders of magnitude less data; he criticizes its under-study in academia.
Deep Learning State of the Art (2019)
Lex Fridman
A technique where a model trained on one task is adapted for a second, related task, often by transferring learned weights or policies.
Andrew Ng at Amazon re:MARS 2019
DeepLearningAI
A technology that helps AI work with small data sets, crucial for industries outside of consumer internet.
MIT 6.S094: Deep Learning for Human-Centered Semi-Autonomous Vehicles
Lex Fridman
A deep learning technique where a pre-trained model is adapted or specialized for a specific individual or task, improving performance when data is limited for that specific case.