What is the Shepard tone illusion and how does it work?

The Shepard tone illusion creates the perception of a continuously ascending pitch using multiple frequencies separated by octaves. As the higher frequencies fade out, new lower frequencies are introduced, giving the continuous impression of rising pitch.

Can visual cues change what we hear?

Yes, the McGurk effect demonstrates that visual information, like lip movements, can override auditory information. The same sound can be perceived as different words depending on the visual context, showing a strong link between sight and sound.

How do we locate the source of a sound?

Humans use four main cues: the difference in volume between ears, the attenuation of higher frequencies in the 'sound shadow' of the head, the time delay of sound arrival at each ear, and the phase of the sound wave at each ear.

Can the human brain adapt to changes in how we perceive sound location?

Yes, studies show that the brain can adapt to altered ear shapes. Participants with modified ear molds initially struggled to locate sounds but improved over time, demonstrating the brain's plasticity in processing spatial audio information.

What are binaural beats and are they effective?

Binaural beats occur when slightly different frequencies are played in each ear, leading the brain to perceive a pulsing beat. While some claim they can improve focus or memory, a 2023 review found the evidence inconclusive, requiring more standardized research.

Are audio illusions a sign of a hearing problem?

No, audio illusions are not indicative of faulty hearing. They highlight the complex ways our brains interpret sound, filling in gaps and making adjustments based on past experiences and expectations to navigate a noisy world.

These Illusions Fool Almost Everyone

Veritasium

Education5 min read25 min video

Aug 14, 2024|5,237,753 views|157,424|20,520

veritasium science physics Audio Illusions sound illusions sound illusion examples Veritasium auditory illusions binaural shepard tone shepard tone illusion Phantom word illusion

Save to Pod

Key Moments

TL;DR

Audio illusions reveal hearing is complex, involving brain interpretation of harmonics, spatial cues, and expectation.

Key Insights

Hearing involves interpreting harmonics, not just fundamental frequencies, to perceive pitch and timbre.

The brain can 'hear' missing fundamental frequencies based on the presence of their harmonics.

Auditory illusions like the Shepard tone demonstrate how the brain can create a sense of continuous ascent.

Visual cues significantly influence auditory perception, a phenomenon seen in the McGurk effect.

Sound localization relies on multiple cues, including volume, frequency attenuation, time delay, and phase differences.

The shape of the ear (pinna) plays a crucial role in sound localization by modifying sound frequencies.

Binaural beats, where different frequencies are played in each ear, can create perceived beats and potentially affect cognitive states.

The cocktail party effect highlights the brain's ability to filter and focus on specific sounds in noisy environments.

Our brains construct our auditory reality by filling in gaps and making predictions based on past experiences and expectations.

Audio illusions demonstrate the active and interpretive nature of the auditory system, rather than passive reception of sound.

THE FUNDAMENTAL FLAW IN THE FREQUENCY FOCUS

Our initial understanding of hearing often simplifies it to merely detecting sound wave frequencies. However, audio illusions reveal a much more intricate process. For instance, a sound with a fundamental frequency of 100 Hz can be perceived as lower than a sound containing that 100 Hz frequency along with higher frequencies like 150 Hz and 200 Hz. This occurs because our brains interpret the combination of frequencies, particularly the presence of harmonics, to determine the perceived pitch and timbre of a sound.

THE MYSTERY OF THE MISSING FUNDAMENTAL

A remarkable auditory phenomenon is the 'missing fundamental.' This illusion demonstrates that even if the lowest frequency (the fundamental) of a sound is absent, our brain can still perceive it if its harmonic overtones are present. For example, a series of harmonics of 50 Hz playing together can lead the brain to hear the 50 Hz fundamental, even though that specific frequency isn't being produced. This principle was historically used in organs to create the sensation of very low notes with shorter pipes by playing their higher harmonic multiples.

THE EVER-ASCENDING SHEPARD TONE

The Shepard tone creates a continuous illusion of ascending pitch, seeming to defy the limits of human hearing. This effect is achieved by layering multiple tones separated by octaves. As the volume of higher frequencies diminishes and lower frequencies increase, the brain perceives a constant rise in pitch, similar to an infinitely ascending staircase. This phenomenon has even been employed in film scores to evoke feelings of unease or tension.

THE POWER OF EXPECTATION: PHANTOM WORDS AND MISHEARD LYRICS

Our brains actively construct our auditory reality, often filling in gaps or misinterpreting sounds based on expectations and context, leading to illusions like the 'phantom word' or 'mandalin' effect. When presented with ambiguous auditory input, especially when combined with visual cues or prior knowledge, our minds can 'hear' words that aren't actually spoken or misinterpret lyrics. This highlights how our cognitive biases and learned patterns significantly shape what we perceive.

THE INTERSECTION OF SIGHT AND SOUND

Visual information profoundly impacts auditory perception, as exemplified by the McGurk effect. When watching someone speak, the visual information of their mouth movements can alter the sound we perceive, even if the audio is identical. Conversely, adding sound can influence our interpretation of visual events, making stationary objects appear to interact. This demonstrates an intrinsic link between our senses, where one can override or influence the other.

NAVIGATING THE NOISY WORLD: THE COCKTAIL PARTY EFFECT

The 'cocktail party effect' describes our remarkable ability to focus on a single conversation amidst a cacophony of other sounds and voices. This is achieved through various cognitive strategies, including predicting upcoming words based on context and language structure, and utilizing spatial cues like the direction of sound. Understanding how we achieve this has led to practical applications, such as improving communication systems for air traffic controllers.

PINPOINTING SOUND: THE CUES OF LOCALIZATION

Accurately locating the source of a sound relies on a combination of critical cues processed by our brain. These include differences in loudness between our ears (due to the head's 'sound shadow'), the way higher frequencies are attenuated more than lower frequencies, the slight time delay of sound arriving at one ear before the other, and the phase difference of the sound wave at each ear. These subtle distinctions allow us to determine the direction and origin of sounds.

THE EAR'S UNIQUE ACOUSTICS AND BRAIN ADAPTATION

The physical shape of our outer ear, the pinna, plays a vital role in sound localization by reflecting and modifying sound frequencies in unique ways depending on the sound's origin. Tiny microphones placed inside ears have shown that different locations amplify or attenuate specific frequencies. Remarkably, the brain can adapt to changes in the pinna's shape, learning to reinterpret these acoustic cues and accurately locate sounds even with altered ear anatomy, and can revert to its original mapping once the alteration is removed.

BINAURAL BEATS: PERCEPTION VERSUS PROOF

Binaural beats occur when slightly different frequencies are presented to each ear, leading the brain to perceive a third, pulsating 'beat' frequency. While some claim these beats can enhance focus or memory, scientific research remains largely inconclusive, with calls for more standardized testing methods. This phenomenon highlights how our brains generate auditory experiences that are not directly present in the physical sound waves themselves.

SUMMATION AND THE REALITY OF HEARING

Ultimately, audio illusions do not signify a faulty hearing system but rather showcase the sophisticated, interpretive, and actively constructing nature of our auditory perception. Our brains are adept at managing the ambiguity and complexity of the real world by filling in missing information and making predictions. While illusions reveal where our perception can be tricked, the overall auditory system is remarkably effective at establishing an accurate understanding of our sonic environment.

Mentioned in This Episode

●Products

●Companies

●Concepts

●People Referenced

Common Questions

This can happen through harmonics, where higher frequencies that are integer multiples of a fundamental frequency can trick the brain into perceiving the missing fundamental, even if it's not explicitly played. The waveform changes, making the period longer, which is interpreted as a lower pitch.

Topics

Audio Illusions Hearing Perception Sound Localization Overtones Shepard Tone McGurk Effect Cocktail Party Effect Auditory Processing Sound Perception

Mentioned in this video

personAlfred Mayer

Professor who presented the 'topophone' in 1880, an early device using adjustable hearing cones to locate distant sounds like ship fog horns.

conceptCocktail party effect

The phenomenon of being able to focus on a single speaker in a noisy environment, which can be achieved through auditory cues like location, prediction, and attention.

productSydney Town Hall pipe organ

A large pipe organ, once the largest in the world, used to demonstrate various audio illusions related to sound production, overtones, and harmonics.

conceptMcGurk effect

An illusion demonstrating how visual cues, specifically mouth movements, can significantly alter auditory perception, showing that vision often dominates hearing.

conceptbinaural beats

A phenomenon where subtle beating is perceived when slightly different frequencies are played in each ear, with some claims of improving focus, though research is inconclusive.

conceptShepard tone

An auditory illusion where a sound seems to continuously ascend in pitch due to multiple frequencies separated by octaves changing volume in a specific way.

personDiana Deutsch

A researcher who developed the phantom word illusion, demonstrating how the brain can create words from ambiguous sounds based on context and priming.

bookDunkirk