Key Moments

Michael I. Jordan: Machine Learning, Recommender Systems, and Future of AI | Lex Fridman Podcast #74

Lex FridmanLex Fridman
Science & Technology5 min read106 min video
Feb 24, 2020|190,174 views|4,002|259
Save to Pod
TL;DR

Michael I. Jordan discusses AI's evolution, from engineering to a human-centric discipline, emphasizing value creation beyond mere prediction.

Key Insights

1

AI is evolving into a new branch of engineering, analogous to chemical or electrical engineering, focused on creating real-world value.

2

True understanding of the human brain is centuries away; current AI inspiration is metaphorical, not based on deep neural principles.

3

"AI" as a field is broad, encompassing systems making decisions under uncertainty at scale, distinct from the philosophical dream of mimicking human intelligence.

4

Current AI successes are engineering achievements, not necessarily scientific breakthroughs or indicators of approaching human-level intelligence.

5

Effective AI systems require a blend of prediction and decision-making, with a critical need to consider risks, externalities, and human impact.

6

The advertising-driven business model of many online platforms limits their potential for creating genuine producer-consumer economic relationships and value.

7

Future AI development should focus on human-centric engineering, empowering individuals and creating new markets rather than replacing human roles.

AI AS ENGINEERING, NOT MERE SCIENCE FICTION

Michael I. Jordan likens the current stage of AI development to the emergence of chemical and electrical engineering from their foundational sciences. He argues that AI is becoming a practical engineering discipline focused on building valuable systems using statistical and computational principles. This is distinct from the historical philosophical aspirations of AI, such as mimicking human thought, which he believes are still centuries away due to our limited understanding of the brain.

THE DISTANCE BETWEEN MAN AND MACHINE INTELLIGENCE

Jordan emphasizes that our understanding of the human brain is fundamentally limited, comparing current metaphors about AI to ancient Greeks speculating about space travel. Neuroscientists agree that comprehending even a single synapse is a monumental task. He cautions against the overselling of "brain-inspired" AI, particularly by those seeking funding, and distinguishes between the scientific understanding of intelligence and the engineering feat of creating useful, albeit not truly intelligent, systems.

REDEFINING ARTIFICIAL INTELLIGENCE BEYOND PREDICTION

Jordan clarifies that the current wave of AI success is not about replicating human intelligence or achieving perfect prediction. Instead, it's about building scalable systems that make consequential decisions under uncertainty. He contrasts this with the emphasis on prediction by some in the field, such as Yann LeCun, arguing that decision-making, risk assessment, and understanding consequences are equally, if not more, critical, especially in real-world applications.

CREATING NEW MARKETS AND EMPOWERING CREATORS

A key focus of Jordan's work is the creation of new markets enabled by AI, moving beyond the limitations of current advertising-driven models. He uses the example of a music market where creators could directly connect with consumers, foster careers, and generate income. This human-centric approach aims to empower individuals by building transparent, valuable systems, creating jobs rather than replacing them, and enhancing human happiness through direct connections.

THE LIMITATIONS AND POTENTIAL OF RECOMENDER SYSTEMS

Recommender systems are crucial for connecting consumers with creators and content. While algorithms are not magic, effective systems can significantly improve user experience, as seen with early Amazon recommendations. However, Jordan notes that systems primarily driven by advertising or simple click-through rates can be problematic, leading to issues like clickbait and the spread of misinformation. He advocates for models that facilitate genuine producer-consumer economic value exchange.

THE CRITICAL ROLE OF BUSINESS MODELS AND ETHICS

Jordan critiques the dominance of advertising-based business models in platforms like Google and Facebook for incentivizing clickbait and potentially harmful content. He suggests that a shift towards direct consumer-producer payment models, even micro-payments, could foster more genuine value creation and ethical practices. Such models require understanding economic principles, respecting culture, and building trust, rather than solely maximizing ad revenue.

PRIVACY, CONTROL, AND THE FUTURE OF HUMAN-TECHNOLOGY INTERACTION

The conversation explores privacy not as a binary issue but as a complex interplay of control and trust. Jordan argues that technology should empower users, providing transparency and agency over their data and interactions. He contrasts the exploitative data practices of some companies with the potential for trusted relationships, likening it to a reliable "old uncle" rather than an intrusive "big brother." Developing these new structures and ethical frameworks is a long-term engineering challenge.

STOCHASTICITY, OPTIMIZATION, AND THE NATURE OF REALITY

Jordan delves into the mathematical underpinnings of AI, highlighting the importance of stochasticity (randomness) in optimization problems. He explains how randomness can help algorithms navigate complex, non-convex landscapes more effectively than purely deterministic methods. This reflects his view that the world is inherently stochastic, and understanding these principles is crucial for building robust AI systems that can operate in the real world.

THE DEBATE BETWEEN BAYESIAN AND FREQUENTIST STATISTICS

He unpacks the fundamental differences between Bayesian and frequentist statistical approaches, linking them to decision theory. Frequentist methods offer guarantees based on hypothetical repeated experiments, suitable for software reliability. Bayesian methods incorporate prior beliefs and focus on the observed data, useful for incorporating human expertise. He advocates for a blend, like empirical Bayes, to leverage the strengths of both in practical applications.

INTELLIGENCE BEYOND HUMANITY: MARKETS AS SYSTEMS

Jordan posits that intelligence is not limited to human cognition. He considers robust, adaptive systems like markets or even decentralized economic networks as forms of intelligence. Studying these systems, he argues, offers more relevant principles for future AI, such as matching and auctions, than trying to solely understand human intelligence, which remains a distant and complex goal.

ADVICE FOR ASPIRING AI PROFESSIONALS

Jordan advises aspiring AI professionals to embrace a journey of lifelong learning, focusing on hard problems, broad exploration, and collaboration. He stresses the importance of apprenticeship, human connections, and a cooperative spirit, likening the path to becoming an artist or musician. He encourages study across disciplines like math, poetry, history, and languages to foster a well-rounded, critically thinking individual.

Common Questions

Michael I. Jordan views the current developments not as 'AI' in the sense of creating human-like intelligence, but rather as the emergence of a new engineering discipline, akin to chemical or electrical engineering. This field builds viable systems that use human data and decisions at scale, valuing practical, understandable, and robust solutions over attempts to mimic human thought.

Topics

Mentioned in this video

People
Michael I. Jordan

Professor at Berkeley and influential figure in machine learning, statistics, and AI, cited over 170,000 times. Lex Fridman's guest.

Yoshua Bengio

World-class researcher in AI, mentored by Michael I. Jordan.

Herbert Robbins

Mathematician from whom ideas like empirical Bayes and FDR emerged around 1960.

John Storey

Provided a Bayesian interpretation of the False Discovery Rate.

Ben Taskar

World-class researcher in AI, mentored by Michael I. Jordan.

Andrew Ng

World-class researcher in AI, mentored by Michael I. Jordan.

Michael J. Jordan

Basketball player mentioned for comparison to Michael I. Jordan's influence.

Bradley Efron

Statistician who has written beautifully about empirical Bayes and related topics.

Miles Davis

Jazz musician used as a metaphor for Michael I. Jordan's explorative and reinventive career.

Stephen Stigler

Colleague at the University of Chicago who wrote a beautiful paper on James-Stein estimation.

Yann LeCun

Fellow AI researcher who calls Michael I. Jordan the 'Miles Davis of machine learning'.

Yoav Benjamini

Pioneer in the development of the False Discovery Rate concept.

Zoubin Ghahramani

World-class researcher in AI, mentored by Michael I. Jordan.

Elon Musk

CEO of Neuralink and SpaceX, mentioned for his views on AI and brain-computer interfaces.

Norbert Wiener

Key figure in cybernetics, mentioned as a contrast to John McCarthy's coining of AI.

John McCarthy

Coined the term 'Artificial Intelligence' as a philosophical aspiration, distinct from cybernetics.

Satya (Nadella)

CEO of Microsoft, credited with changing the company's approach to user trust and privacy.

More from Lex Fridman

View all 505 summaries

Found this useful? Build your knowledge library

Get AI-powered summaries of any YouTube video, podcast, or article in seconds. Save them to your personal pods and access them anytime.

Try Summify free