Key Moments
Digital Delusions: A Conversation with Renée DiResta (Episode #378)
Sam HarrisKey Moments
Information landscape is manipulated by niche communities, influencers, and profit motives, creating digital delusions.
Key Insights
Propaganda has evolved from mass media to targeted, niche communication amplified by social media algorithms and closed communities.
The 'two-step flow' of communication is amplified online, where influencers within niche communities shape perceived consensus.
Asymmetry of passion, driven by coordinated efforts and algorithmic curation, creates an illusion of majority opinion.
Audience capture incentivizes influencers to cater to their niche, potentially leading to radicalization and a 'race to the bottom'.
Misinformation, particularly around health topics like COVID-19 vaccines, thrives due to distrust in institutions and rapid politicization.
The discourse on censorship and free speech online is often weaponized, obscuring actual political motivations and government actions.
THE EVOLUTION OF PROPAGANDA IN THE DIGITAL AGE
Renée DiResta, in conversation with Sam Harris, details how the concept of propaganda has shifted from its historical meaning to a contemporary pejorative. Historically, propaganda referred to the propagation of information, but post-WWII, it became associated with manipulative tactics by adversaries. DiResta defines it as a systematic effort to influence attitudes and behaviors using biased or misleading information for an unclear agenda, differentiating it from ethical persuasion. This has been radically altered by new communication technologies, moving propaganda from mass media to highly targeted, niche communication.
THE RISE OF NICHES AND CLOSED COMMUNITIES
The transition to social media has enabled propaganda to become more niche and targeted, diverging from the mass media era. Unlike traditional media that aimed for broad narratives, social media allows for fragmented communication within closed, global yet niche communities. These communities reinforce messages through the 'two-step flow' of communication, where opinion leaders within trusted groups mediate information, making it appear as consensus even if it's a vocal minority. This structure allows curated messages to resonate deeply within these enclaves.
THE ASYMMETRY OF PASSION AND AUDIENCE CAPTURE
DiResta highlights the 'asymmetry of passion,' where small, activated groups coordinated online can create the illusion of a majority opinion. This is amplified by algorithms that surface content, making fringe ideas seem widespread. Furthermore, 'audience capture' describes a phenomenon where influencers, driven by social and financial incentives (like ad rev share or patron support), increasingly cater to their niche's sentiments. This can lead to a 'race to the bottom,' where creators become more extreme to maintain engagement and profitability, further radicalizing their audience.
COVID-19 AS A CASE STUDY FOR MISINFORMATION
The COVID-19 pandemic served as a critical case study for the challenges of information dissemination during a crisis. Early in the outbreak, state media from China began shaping narratives. Simultaneously, anti-vaccine groups saw it as an opportunity to promote their agenda, often engaging in contradictory claims, such as the virus being not real yet necessitating a vaccine. Public health authorities struggled to adapt to modern communication, often appearing to react late, which eroded trust. The politicization of public health measures and the rise of distrust in institutions exacerbated the spread of misinformation.
THE UNIQUE NATURE OF VACCINE HESITANCY
Vaccine hesitancy is explored as a particularly potent area of health misinformation, with roots tracing back to the 1800s. DiResta notes that the discourse often centers on fears related to child health, connecting vaccines to serious outcomes like autism or SIDS, despite scientific debunking. This is amplified by an asymmetry between the perceived (or actual) harm of intervention and the abstract, unconfirmed benefit of prevention. Declining trust in government and health authorities further fuels this hesitancy, making individuals more susceptible to conspiratorial narratives.
POLITICAL RETALIATION AND THE WEAPONIZATION OF CENSORSHIP CLAIMS
DiResta shares her personal experience of being targeted by smear campaigns, particularly in relation to her work at the Stanford Internet Observatory and the Election Integrity Partnership. Critics, including figures like Matt Taibbi and Michael Shellenberger, reframed her team's study of election narratives as a vast censorship operation, despite evidence to the contrary. This discourse on censorship and misinformation has been weaponized by political actors, including members of Congress and state attorneys general, to pursue what DiResta describes as political retaliation, often overshadowing genuine concerns about election integrity.
Mentioned in This Episode
●Software & Apps
●Companies
●Organizations
●Books
●Concepts
●People Referenced
Common Questions
Propaganda is defined as the systematic and deliberate effort to influence attitudes, beliefs, and behaviors using biased or misleading information to promote a specific, often unclear, agenda. Persuasion, in contrast, is seen as a more ethical appeal that respects the audience's autonomy and does not rely on fakery or selective omission of information.
Topics
Mentioned in this video
Mentioned in the context of his appearance at the National Association of Black Journalists, his performance, and alleged racist remarks about Kamala Harris.
Used as a comparison to describe Donald Trump's perceived outdated racial software.
Mentioned as a contrast to Donald Trump's demeanor and fluidity in public speech.
Discussed in relation to Donald Trump questioning her race and her political strategy to pivot to the center.
Cited as an example of historical propaganda and influence from nearly 100 years ago, used for comparison to modern techniques.
Mentioned as a co-guest with Renee DiResta on a previous podcast episode.
The guest on the podcast, author of 'Invisible Rulers,' whose work focuses on influence and propaganda.
Associated with America First Legal, which sued Renee DiResta and the Stanford Internet Observatory based on allegations related to the 2020 election.
Host of the podcast on which Renee DiResta appeared, and which Sam Harris claims to have influenced.
Mentioned as someone who, along with Matt Taibbi, smeared Renee DiResta and was involved in the Twitter files.
Mentioned as an Attorney General who supported efforts to overturn the Pennsylvania vote, linking him to the 'big lie'.
Chairman of a committee to which Matt Taibbi and Michael Shellenberger provided testimony regarding the Twitter files.
Mentioned as making baseless allegations about an 'AI censorship Death Star' related to Renee DiResta's work.
Mentioned as someone who, along with Michael Shellenberger, smeared Renee DiResta and was involved in the Twitter files.
Credited with coining the term 'audience capture,' which is discussed in the context of influencers and their audiences.
Host of the podcast, discussing his own views on politics and introducing the guest and topics.
Mentioned as someone Michael Shellenberger spoke with about Renee DiResta's podcast appearances.
Mentioned in relation to the Twitter files and their potential release.
Author whose work on how crowds trend towards extremism is mentioned as a contributing factor to online radicalization.
Associated with the 'crunchy lefty crazies' era of the anti-vaccine movement.
The event where Donald Trump made remarks that are discussed in the introduction.
Publications where Renee DiResta has been featured.
The Digital Forensics Research Lab at the Atlantic Council collaborated on the Election Integrity Partnership.
Mentioned as an entity that state and local election officials could contact, with or without the help of researchers.
Renee DiResta's former workplace, where she studied adversarial abuse online, including propaganda and disinformation campaigns.
Mentioned as a topic that was explicitly out of scope for the Election Integrity Partnership project but later lumped in by critics.
Publications where Renee DiResta has been featured.
Investigated for propaganda operations and election interference in the US from 2015-2018.
Russian military intelligence involved in hack-and-leak operations.
Mentioned as an institutional health authority whose content is often perceived as boring and not widely shared.
Organization that sued Renee DiResta based on allegations related to the 2020 election.
A project run by Stanford Internet Observatory in 2020 that studied narratives about voting, which was later reframed by critics.
Russian organization whose propaganda operations were investigated using data shared by social media platforms.
Received data sets from social media platforms related to Russian propaganda operations for investigation.
Collaborated with Stanford Internet Observatory on the Election Integrity Partnership project.
Sam Harris mentions publishing a piece on Substack about Kamala Harris's political strategy.
Publications where Renee DiResta has been featured.
A group that collaborated with Stanford Internet Observatory on the Election Integrity Partnership project.
Mentioned in the context of election fraud narratives and lawsuits, which were not censored but widely discussed.
A key theme discussed in relation to misinformation, public health policy, and the evolution of anti-vaccine movements.
A property of certain drugs that can cause hearing loss, mentioned in the context of Sam Harris's personal experience with hearing loss.
Related to the asymmetry of passion, where online discourse can create a false sense of widespread agreement.
A communication model explaining opinion formation through opinion leaders and trusted communities.
Refers to the narratives and efforts to delegitimize the 2020 election, which is discussed in relation to the smear campaign against DiResta.
Central themes of Renee DiResta's work and the podcast discussion.
Used as a historical parallel to discuss the impact of new communication technologies on the spread of information.
Site of a measles outbreak that contributed to the development of platform policies regarding health information.
A broad topic discussed in the podcast episode.
A core concept defined and discussed in the context of its historical evolution and modern manifestations online.
The motivation behind the legal and political attacks on Renee DiResta and the Stanford Internet Observatory, according to the discussion.
A communication theory explaining how media messages are processed through opinion leaders in trusted communities.
Discussed as a driver of changes in how propaganda and influence operate.
A phenomenon where passionate minorities can appear as a majority online, discussed in the book.
A topic explored in the book and discussion, focusing on what public health and communication strategies went wrong.
Examined to understand why vaccines, in particular, generate such intense activism and conspiracy theories.
Differentiated from propaganda, often seen as a more ethical form of influence that respects audience autonomy.
Discussed in the context of vaccine hesitancy, where the fear of potential harm outweighs perceived benefits or the avoidance of abstract risks.
Mentioned as a risk that anti-vaccine narratives falsely associate with childhood immunizations.
The phenomenon where influencers tailor their content to the perceived desires of their audience, sometimes leading to radicalization.
Discussed in relation to accusations of censorship, particularly concerning the handling of election narratives.
A framework discussed in relation to platform policies on content amplification and recommendation.
Discussed as an example of a policy decision by platforms to 'throttle' a specific narrative, later criticized and used to undermine other policies.
Related to harm aversion, the psychological principle that the pain of losing something is often greater than the pleasure of gaining something equivalent.
A condition falsely linked to vaccines by anti-vaccine narratives, despite being repeatedly debunked.
Examined as key components of modern influence and propaganda, particularly on social media.
Critiqued in the book and discussion, arguing social media's structure is more akin to a gladiatorial arena than a deliberative space.
Discussed as a factor in the politicization of issues like vaccines, especially among certain political demographics.
Location of a measles outbreak for which platform policies were developed, predating COVID-19.
Mentioned as a source of geopolitical campaigns and disinformation operations studied by DiResta.
Mentioned as a source of geopolitical campaigns and disinformation operations studied by DiResta.
Mentioned as a site from which a bioweapon might have originated, according to some online narratives during the early stages of the COVID-19 pandemic.
Mentioned as a source of geopolitical campaigns and disinformation operations studied by DiResta.
Used as a personal example by Sam Harris to illustrate how individual negative reactions to medication do not typically lead to activism, unlike with vaccines.
The first form of vaccination, dating back to the 1800s, which was viewed with suspicion and compared to witchcraft.
More from Sam Harris
View all 90 summaries
10 minThe War Was Necessary. The Way Trump Did It Wasn’t.
1 minBen Shapiro Knows Better
1 minMost People Know as Much About Politics as They Do Football… Not Much
2 minTrump is Going to Burn it All Down...What Are We Going to Build Instead?
Found this useful? Build your knowledge library
Get AI-powered summaries of any YouTube video, podcast, or article in seconds. Save them to your personal pods and access them anytime.
Try Summify free