How is AI advancing the creation of synthetic media?

AI is rapidly improving in generating synthetic media to a Hollywood-level fidelity at low cost. Unlike older CGI which struggled with human likeness, AI can now perfectly generate realistic human faces, voices, and even video, making it accessible to almost anyone.

What are the potential positive and negative uses of synthetic media?

Legitimate commercial applications include corporate communications, advertising, and entertainment like movies and video games. However, the most potent use is for spreading disinformation, hijacking biometrics (voice and likeness), and creating evidence that can be faked or denied.

What are the proposed technical solutions for combating deep fakes?

Technical solutions include developing AI software to detect deep fakes, though this is an ongoing arms race with generation models. Another approach is building provenance architecture, embedding watermarks into hardware like cameras to track media authenticity and prevent tampering.

Why are human societal resilience and education crucial for fighting disinformation?

Despite technical solutions, the problem is fundamentally human because disinformation has always existed but is now more potent and accessible. Society needs to build resilience through education about the risks of synthetic media and establishing ethical frameworks for its use.

What is Russia's historical role in information warfare?

Russia has a long history of 'active measures,' employing information warfare and psychological operations. This includes spreading disinformation during the annexation of Crimea, weaponizing the European migrant crisis, and interfering in US elections since at least 2013.

How does Russia exploit societal divisions, particularly racial ones?

Russia strategically targets societal fault lines, like race in the US. They create fake online communities and pages, specifically targeting groups like the African-American community, to sow grievances, promote alienation, and discourage voting, as seen in the 2016 election interference.

How has China adopted similar disinformation tactics?

China has recently become more aggressive in pursuing disinformation campaigns in Western information spaces, mirroring Russia's strategies. This increased activity was particularly noted around the Hong Kong protests and the COVID-19 pandemic.

Key Moments

The Information Apocalypse: A Conversation with Nina Schick (Episode: #220)

Sam Harris

Science & Technology3 min read48 min video

Oct 17, 2020|89,169 views|1,672|925

sam harris sam harris podcast waking up podcast waking up waking up with sam harris sam harris waking up waking up sam harris sam harris jordan peterson sam harris joe rogan author neuroscientist philosopher

Save to Pod

Key Moments

TL;DR

Deepfakes and AI-generated media are leading to an information apocalypse, eroding trust and reality.

Key Insights

AI-generated synthetic media, including deepfakes, is rapidly advancing, making it difficult to distinguish real from fake content.

This technology democratizes the creation of highly realistic fake media, posing a significant threat to truth and trust in institutions.

Foreign actors, particularly Russia, have a history of sophisticated information warfare, exploiting societal divisions, especially racial ones.

The architecture of social media amplifies misinformation by promoting engagement over accuracy, creating echo chambers and polarization.

Combating the information apocalypse requires a multi-faceted approach including technological solutions, societal resilience, and digital education.

The erosion of trust in media and institutions, coupled with the rise of synthetic media, creates a dangerous environment where reality itself is contested.

THE RISE OF SYNTHETIC MEDIA AND DEEP FAKES

The conversation centers on the alarming rise of synthetic media, which is any media—images, video, or text—generated by artificial intelligence. This technology is rapidly advancing, moving beyond Hollywood's capabilities to a point where convincing fake human faces can be generated effortlessly, as demonstrated by "this person does not exist.com." The implications are profound, as AI can now synthesize voices and digital likenesses, democratizing the creation of highly realistic fake content. This capability, while having commercial applications, is also the most potent form of disinformation, capable of transforming how we perceive reality.

THE DEMOCRATIZATION OF DISINFORMATION

The alarming aspect of synthetic media is its increasing accessibility. While advanced deepfakes currently require some technical knowledge, the trend points towards easily usable apps and software that will enable almost anyone to create sophisticated fake content. This poses a significant threat because the barriers to entry are diminishing rapidly. The ease with which content can be generated means that malicious actors, or even individuals with less harmful intentions, can flood the information ecosystem with believable falsehoods, making it increasingly difficult for the public to discern truth from fiction.

HISTORICAL CONTEXT OF RUSSIAN INFORMATION WARFARE

Nina Schick highlights Russia's long history of "active measures" and information warfare, dating back to the Cold War. The tactics have evolved with technology, particularly through social media influence operations. Examples given include the denial of the annexation of Crimea, the manipulation of narratives around the Syrian refugee crisis to divide Europe, and sophisticated interference in the 2016 US election. These operations involve creating fake online personas and communities to sow discord and distrust, often disproportionately targeting specific demographics like the African-American community.

EXPLOITING SOCIETAL DIVISIONS AND ERODING TRUST

A key strategy employed by adversaries is the exploitation of existing societal divisions, particularly racial tensions. The podcast references historical Soviet disinformation campaigns, such as the lie that AIDS was a bio-weapon created to harm Black people, which still resonates today. In contemporary elections, influence operations have focused on exacerbating identity politics and creating alienation among various groups. The goal is not just to misinform but to foster a deep-seated cynicism and break people's commitment to seeking truth, leading to an "epistemological breakdown" and a tuning out from civic engagement.

THE FAILURE OF INSTITUTIONS AND THE ROLE OF SOCIAL MEDIA

Schick emphasizes that the current information ecosystem has become deeply corrupted, a process only accelerated by social media's architecture. The business model, driven by engagement and ad revenue, often selects for sensationalism and conflict over accuracy. This has led to a collapse of trust in traditional institutions, including journalism and government. The widespread inability to agree on basic facts or even the nature of problems, such as foreign interference, is a symptom of this pervasive information disorder, making it difficult to identify and address existential risks.

POTENTIAL SOLUTIONS AND THE URgency of ACTION

Addressing the impending 'information apocalypse' requires a multi-pronged approach. Technical solutions include developing AI for detecting deepfakes and embedding authenticity watermarks into media at the hardware level. However, the adversarial nature of AI means detectors constantly lag behind generative models. Crucially, societal resilience must be built through widespread digital literacy education. The conversation underscores that while technology facilitates disinformation, the root problem is human intent and societal vulnerabilities. There is an urgent need to establish ethical frameworks and educate the public, as the window for meaningful action is closing rapidly.

Mentioned in This Episode

●Supplements

●Software & Apps

●Companies

●Organizations

●Books

●Studies Cited

●Concepts

●People Referenced

Common Questions

Deep fakes are synthetic media (images, audio, video) generated by AI. They pose a significant problem because they can be used for misinformation and disinformation, making it increasingly difficult to discern reality and trust information, potentially leading to societal breakdown.

Topics

Ai-Ethics Information Warfare AI & Machine Learning Technology & Innovation Society & Philosophy Politics & Policy Election Interference Synthetic Media Disinformation Campaigns Social Media Manipulation Digital Forensics

Mentioned in this video

People

Joe Pesci

Actor in 'The Irishman' whose de-aging in the film was discussed in contrast to newer, faster AI technologies.

Robert De Niro

Actor in 'The Irishman' whose de-aging in the film was discussed in contrast to newer, faster AI technologies.

Nina Schick

Author and broadcaster specializing in technology and AI's impact on society; advised global leaders and wrote the book 'Deep Fakes'.

University College London

University where Nina Schick holds a degree.

Joe Biden

Former US Vice President and President, advised by Nina Schick on how the 2020 election could be impacted by emerging threats.

Sam Harris

Host of the Making Sense podcast, conversational partner with Nina Schick.

Gretchen Whitmer

Governor of Michigan, who was Plotting to be kidnapped by a militia group in an incident related to political extremism.

Organizations

Black Lives Matter

Social movement discussed in relation to Russian fabricated Facebook groups and fake news networks designed to sow division.

Russian state-sponsored television network reported to be the most watched news channel on YouTube.

BBC

Media company where Nina Schick is a regular contributor.

Internet Research Agency

Russian agency responsible for social media influence operations, including those targeting the 2016 and 2020 US elections.

CNN

Media company where Nina Schick is a regular contributor.

NATO

North Atlantic Treaty Organization; Nina Schick worked with the former Secretary General of NATO.

Cambridge University

University where Nina Schick holds a degree.

European Union

Political and economic union impacted by the migrant crisis, which Russia allegedly weaponized through information operations.

Companies

Sky

Media company where Nina Schick is a regular contributor.

Bloomberg

Media company where Nina Schick is a regular contributor.

Adobe

Company working on the Content Authenticity Initiative to embed watermarks and prove media provenance.

YouTube

Video platform where many early synthetic media examples have emerged, and where RT is a highly watched news channel.

Studies & Research

Tuskegee experiments

A historical US Public Health Service study where African American men with syphilis were left untreated, cited as a basis for plausibility of later disinformation campaigns targeting the Black community.

Locations

China

Country noted for becoming more like Russia in its pursuit of disinformation campaigns in Western information spaces.

Ukraine

Country where Russia waged an information war during its annexation of Crimea and intervention in eastern Ukraine.

Russia

Country discussed for its history of 'active measures' and information warfare, including election interference and exploitation of societal divisions.

Crimea

Region annexed by Russia, a key event discussed in the context of Russian information warfare.

Syria

Country where Russia stepped up bombardment of civilians, contributing to a mass migration crisis in Europe.

Software & Apps

Vocal Synthesis

A YouTuber using open-source AI to synthesize celebrity voices, including historical figures and musicians.

Reface

An app that allows users to swap their faces into popular film scenes, demonstrating accessible synthetic media creation.

Concepts

Russian active measures

Historical and ongoing strategy employed by Russia to influence foreign political landscapes through disinformation and psychological operations.

Media

The Irishman

Martin Scorsese film where de-aging technology was used, highlighting the rapid advancement of visual effects through AI.

condition

HIV

Human Immunodeficiency Virus, discussed in the context of a historical Russian disinformation campaign falsely claiming it was a US-made bioweapon to target the Black community.

Books

Deep Fakes

Nina Schick's book that explores the coming age of synthetic media and its societal impact.