How is social media different from traditional media's competition for attention?

While attention has always been a finite resource, social media's difference lies in the intimate integration of smartphones into daily life and the immense asymmetry of power. Highly sophisticated algorithms and supercomputers on these platforms use predictive analytics to keep users engaged, unlike older media or even newspapers.

What does Tristan Harris mean by a 'shattered epistemology'?

A shattered epistemology refers to a breakdown in how we collectively determine what is true. Social media algorithms create personalized realities and echo chambers, making it impossible to agree on basic facts and leading to a fragmented understanding of the world.

How do social media algorithms contribute to radicalization and conspiracy theories?

Algorithms are designed to maximize engagement, often by recommending increasingly extreme content. This can trap users in rabbit holes, such as pushing conspiracy theories like flat earth or QAnon, and even connect unrelated niche communities, as seen with anti-vaccine groups being linked to other conspiracy communities.

What is the core business model driving these social media problems?

The primary driver is the advertising model, which necessitates capturing and holding user attention. This model incentivizes platforms to continually refine ways to gain and monetize attention, often by exploiting human psychological vulnerabilities and amplifying engaging content like outrage.

How does social media threaten democracy?

By fracturing shared reality and spreading misinformation and outrage, social media makes it impossible to have constructive conversations and converge on basic facts. This erodes the foundation needed for a healthy democracy and makes societies vulnerable to manipulation by malicious actors.

What is the difference between platforms selling data vs. selling predictions?

Platforms generally don't sell raw user data. Instead, they gather and analyze data to sell highly accurate predictions of user behavior to advertisers, enabling highly effective targeted advertising.

Key Moments

Welcome To The Cult Factory: A Conversation with Tristan Harris (Episode #218)

Sam Harris

Science & Technology3 min read47 min video

Sep 25, 2020|161,632 views|3,269|916

sam harris sam harris podcast waking up podcast waking up waking up with sam harris sam harris waking up waking up sam harris sam harris jordan peterson sam harris joe rogan author neuroscientist philosopher

Save to Pod

Key Moments

TL;DR

Social media exploits human weaknesses, fracturing society and democracy through a misaligned advertising model that prioritizes engagement over truth.

Key Insights

Social media platforms are designed to exploit human psychological vulnerabilities, leading to addiction, depression, and polarization.

The current advertising-driven business model incentivizes platforms to maximize user engagement, often by promoting extreme or false content.

Misinformation and conspiracy theories spread rapidly due to algorithms that prioritize engagement over factual accuracy, eroding shared reality.

This fragmentation of reality hinders societal cohesion, making it difficult to address critical issues like climate change and pandemics.

There is a significant asymmetry of power between sophisticated algorithms and the human prefrontal cortex, making individuals highly susceptible to manipulation.

External actors can exploit these platforms for information warfare, exacerbating existing societal tensions.

HUMAN WEAKNESSES EXPLOITED BY TECHNOLOGY

The core problem with social media is not that it overwhelms human strengths, but rather that it actively undermines human weaknesses. This occurs through various mechanisms: overwhelming short-term memory leads to distraction, dopamine systems are hacked, fostering addiction, and reliance on social cues is exploited, contributing to issues like teen depression. Furthermore, heuristics for discerning truth are compromised, making individuals susceptible to bots, deepfakes, and misinformation.

THE ATTENTION ECONOMY AND ITS ASYMMETRY

While competition for attention is not new, social media has intensified it through smartphones, which are now deeply integrated into daily life and serve as primary information routers. The key difference lies in the extreme asymmetry of power: sophisticated AI and vast computing power on one side are pitted against the human prefrontal cortex, evolved for a different era. This creates an uneven playing field where platforms know us better than we know ourselves.

THE EROSION OF SHARED REALITY

A critical and genuinely new problem is the siloing of information and the breakdown of a shared reality. Algorithms curate personalized information feeds, meaning individuals inhabit entirely different informational worlds. This fragmented epistemology makes convergent thinking impossible, akin to everyone experiencing their own 'Truman Show.' The inability to agree on basic facts erodes societal cohesion and makes constructive discourse difficult.

THE ROLE OF THE ADVERTISING MODEL AND INFORMATION WARFARE

The underlying issue stems from the dominant advertising-driven business model, which incentivizes platforms to maximize engagement above all else. This model has inadvertently created a 'cult factory' or 'cult industrial complex.' This infrastructure is not only used to sell products but is also weaponized for information warfare. Countries can exploit these platforms to stoke division and exacerbate existing tensions, turning populations against themselves.

ALGORITHMIC PROPAGANDA AND MISINFORMATION SPREAD

Platforms like YouTube and Facebook, driven by algorithms, recommend content that generates the most engagement, not necessarily the most truthful or beneficial content. Studies show significant portions of viewing time are driven by these recommendation systems, which can lead users down rabbit holes of extreme views, conspiracy theories, or harmful content. This is amplified because platforms often remove human editors, relying on machines that cannot distinguish between what people will watch and what they truly need.

CONSEQUENCES AND THE NEED FOR CHANGE

The consequences of this system include political polarization, an inability to address crises like climate change or pandemics, and a general decline in societal sanity. The lack of a shared reality makes democracy unsustainable, as it relies on a foundation of informed discourse. While people may not always feel overtly violated by targeted advertising, the passive acceptance of this 'psychological experiment' in exchange for free services has profound, unexamined consequences for individual and collective well-being.

Mentioned in This Episode

●Products

●Software & Apps

●Companies

●Organizations

●Concepts

●People Referenced

Common Questions

The Social Dilemma is a Netflix documentary featuring tech insiders discussing the negative impacts of social media. It highlights how technology undermines human weaknesses through practices like addiction, polarization, and the breakdown of truth, which is the central theme of this conversation.

Topics

Social Media Information Warfare Mindset & Self-Improvement AI & Machine Learning Technology & Innovation Society & Philosophy Attention Economy Algorithmic Manipulation Persuasive Technology

Mentioned in this video

Companies

Google

Tristan Harris's former employer, where he worked as a design ethicist. Google's vast infrastructure and its role in the attention economy are discussed.

YouTube

A major social media platform where the recommendation system drives a significant portion of user engagement, often leading to extreme content suggestions and conspiracy theories.

Netflix

The streaming platform where 'The Social Dilemma' documentary is available. Discussed as having a distinct business model from traditional social media platforms, potentially less reliant on the ad economy.

Apsure

A technology company founded by Tristan Harris that was acquired by Google.

Facebook

A prominent social media platform, criticized for its algorithms that can exploit human weaknesses and contribute to polarization and misinformation.

TikTok

Mentioned as a platform with a large user base that can be used to manipulate political discourse, particularly by foreign entities like China.

People

Aldous Huxley

Author mentioned in relation to a dystopian vision of people passively consuming media, drawing a parallel to historical television viewing habits and current digital engagement.

Alex Jones

A conspiracy theorist whose platform, Infowars, was heavily promoted by YouTube's recommendation system, highlighting the spread of misinformation.

Bill Gates

Mentioned as part of conspiracy theories amplified by social media algorithms, alongside 5G and other unfounded claims.

Roger McNamee

Mentioned as a source for the 'Truman Show' analogy, referring to individuals living in personalized, algorithmically curated information realities.

Gary Kasparov

A legendary chess grandmaster, used as an analogy to illustrate the immense asymmetry between human cognitive abilities and the predictive power of AI and supercomputers used by tech platforms.

Sun Tzu

Ancient Chinese military strategist whose principles of turning an enemy against themselves are applied to the modern context of information warfare facilitated by social media platforms.

Jaron Lanier

A digital philosopher and computer scientist who previously appeared on the podcast, quoted for his analogy of Wikipedia presenting information based on search history, highlighting the shattered epistemology of the internet.

Rene DiResta

A researcher previously on the podcast, mentioned for her work on how radicalization spreads on social media, particularly through suggested user systems.

Locations

China

Mentioned as a country that can leverage platforms like TikTok to manipulate political discourse and create division within other nations.

Russia

Identified as a foreign actor that deliberately games social media systems to sow discord, heighten polarization, and spread disinformation, posing a threat to democratic processes.

Media

The Social Dilemma

A new Netflix documentary discussed in the conversation, featuring technology insiders speaking about the negative impacts of social media and the technology they helped create.

Infowars

Conspiracy theory platform associated with Alex Jones, heavily promoted by YouTube, illustrating the scale of misinformation spread.

Organizations

Persuasive Technology Lab

A lab at Stanford where Tristan Harris studied, focusing on how the human mind is vulnerable to psychological influence.

MSNBC

A news channel contrasted with the reach of conspiracy theories on social media and mentioned in the context of partisan echo chambers.

Vanity Fair

A magazine mentioned as an example of traditional media that competed for attention, used to contrast with the current, more sophisticated methods of engagement employed by social media platforms.

The Guardian

A news organization whose reach is contrasted with the amplified reach of conspiracy theories on platforms like YouTube and Facebook.

New York Times

A major news organization whose reach is contrasted with the amplified reach of conspiracy theories on platforms like YouTube and Facebook.

Fox News

A news channel contrasted with the reach of conspiracy theories on social media and mentioned in the context of partisan echo chambers.

ISIS

Mentioned in the context of Rene Diresta's research on how social media platforms can suggest extremist accounts, demonstrating algorithmic radicalization pathways.

Black Lives Matter

A social movement discussed in the context of how foreign actors like Russia can intentionally spread information and disinformation to exacerbate societal divisions and polarization.

Concepts

Mentioned as part of conspiracy theories amplified by social media, alongside claims about Bill Gates and a virus, illustrating the spread of misinformation.

QAnon

A far-right conspiracy theory movement discussed as an example of how social media platforms can facilitate the spread of extreme beliefs and radicalization.

Products

Prius

A car mentioned as an example of a purchase that might feel justified to a consumer, even if driven by targeted advertising, suggesting that users may not always feel violated when buying something they desired.