What's the difference between radiance in light simulation and display RGB values?

Light simulations output radiance, which represents the actual amount of light traveling in a direction and can have an extremely wide range of values (e.g., 80 million:1 difference between darkest and brightest). Displays, however, expect RGB values, which have a much more limited dynamic range (typically around 1000:1) and are encoded in fewer bits (like 8 bits per channel), making them insufficient to show the full radiance spectrum.

How does the human eye handle dynamic range?

The human eye has an impressive dynamic range, estimated around 100 million:1, allowing us to perceive differences in brightness across vastly different conditions. This is achieved through several mechanisms: biochemical adaptation of photoreceptors (two orders of magnitude), pupil size adjustment (one order of magnitude), and neural adaptation for signal processing.

What are the main issues with simply dividing radiance by the maximum value?

Simply dividing all radiance values by the maximum value in a scene is problematic because the maximum is often an extremely bright specular highlight or light source. This approach would scale down everything else so much that only that single bright spot would be visible, effectively losing almost all detail from the rest of the image.

What is the difference between global and local tone mapping?

Global tone mappers use a single, uniform mapping function applied to all pixels, making them fast and suitable for parallel processing like GPUs. Local tone mappers, however, consider a pixel's neighbors, allowing for local contrast enhancement and perceptually motivated adaptation, but they are computationally more complex and slower.

Is HDR photography the same as tone mapping?

While HDR photography and tone mapping share methodologies in handling high dynamic ranges, they are not the same. HDR photography often combines multiple exposures and can be used artistically, sometimes leading to exaggerated effects like halos or oversaturation. Tone mapping in light simulation aims for a perceptually and physically validated approach to achieve realistic scene impressions without such artistic distortions.

What is the Reinhardt tone mapper?

The Reinhardt tone mapper is a widely implemented and sophisticated tone mapping algorithm used to compress high dynamic range luminance values for display. It is considered one of the most common tone mappers found in rendering software.

Key Moments

TU Wien Rendering #21 - Tone Mapping Basics

Two Minute Papers

Science & Technology3 min read23 min video

Apr 30, 2015|6,250 views|86|4

Rendering Global Illumination ray tracing Vienna University Of Technology (College/University)tone mapping hdr tone mapping unity tonemapping rendering lecture radiance mapping

Save to Pod

Key Moments

TL;DR

Rendering challenge: Display large radiance ranges on limited screens. Tone mapping compresses & adapts.

Key Insights

Light simulations output radiance, but displays need RGB values.

Radiance values have a vast dynamic range (up to 80 million:1), far exceeding display capabilities (around 1000:1).

Human vision also has a large dynamic range (around 100 million:1), achieved through biochemical and neurological adaptation.

Tone mapping is essential to compress high dynamic range radiance to low dynamic range for display.

Tone mapping involves range compression and adherence to standardized color spaces.

Global tone mappers apply a uniform function, while local tone mappers consider pixel neighborhoods for adaptive contrast enhancement.

THE RADIANCE-TO-RGB CHALLENGE

Computer graphics simulations aim to calculate radiance, which quantifies light traveling through a scene. However, display devices like monitors cannot directly show this radiance. They expect RGB color values. While radiance can carry color information, converting the immense range of simulated radiance values into a format suitable for displays is a complex problem. This conversion is not straightforward due to the vast differences in light intensity found in the real world.

THE VAST DYNAMIC RANGE OF LIGHT

Real-world light intensities vary dramatically. For instance, the difference between sunlight and moonlight on Earth can be a factor of 800,000. Add to this the reflectivity of surfaces (white versus black), and the ratio between the darkest and brightest visible light in a single scene can reach an astonishing 80 million to one. This high dynamic range (HDR) is crucial for perceiving details in both bright and dark conditions, a capability evolved in human vision.

LIMITATIONS OF DISPLAY TECHNOLOGY

Human vision boasts a remarkable dynamic range, capable of adapting to light differences of up to 100 million to one through photochemical bleaching, pupil size, and neural adaptation. In contrast, standard displays have a significantly limited dynamic range, typically around 1,000 to one. Furthermore, 8-bit color encoding, common in image files, provides only 256 levels per color channel, further restricting the display of subtle gradations in brightness found in HDR scenes.

THE ROLE OF TONE MAPPING

Tone mapping, also known as tone reproduction, is the process designed to bridge the gap between the high dynamic range output of light simulations and the low dynamic range capabilities of display devices. It involves compressing the wide range of luminance values into a narrower range that can be effectively displayed without losing crucial visual information, ensuring that both dark and bright areas are perceivable.

APPROACHES TO TONE MAPPING

Tone mapping techniques can be broadly categorized into global and local methods. Global tone mappers apply a single, uniform mapping function across the entire image, making them computationally efficient and suitable for parallel processing on GPUs. Local tone mappers, however, consider the surrounding pixels of a given pixel, allowing for adaptive contrast enhancement. This local approach is perceptually motivated, mimicking how the human eye adapts its brightness perception based on local conditions.

GLOBAL VERSUS LOCAL MAPPING

Global tone mappers are fast and simpler to implement, processing each pixel independently with the same formula. This speed is advantageous for real-time rendering. However, they can suffer from a loss of detail because they don't account for local variations in scene luminance. Local tone mappers offer more sophisticated control by adjusting the mapping based on the pixel's neighborhood, enabling better detail preservation and contrast locally, but at the cost of increased computational complexity and slower performance.

DISTINGUISHING TRUE TONE MAPPING

It is crucial to differentiate technical tone mapping from artistic manipulation often seen in casual HDR photography. While tone mapping aims for a perceptually and physically validated representation of a scene's dynamic range, some HDR photography heavily overuses these capabilities, resulting in unnatural effects like excessive halos, oversaturated colors, and an overall artificial appearance. True tone mapping should produce realistic impressions, not aesthetic alterations for their own sake.

REINHARDT TONE MAPPER AND HDR PHOTOGRAPHY

The Reinhardt tone mapper is a commonly implemented algorithm in rendering software. It's robust enough to be applied in contexts like High Dynamic Range (HDR) photography, which involves combining multiple exposures of the same scene. When applied correctly, tone mapping in HDR photography should yield realistic results, subtly enhancing contrast and detail without the egregious visual artifacts associated with misused HDR techniques.

Mentioned in This Episode

●Software & Apps

●Concepts

Tone Mapping Dos and Don'ts

Practical takeaways from this episode

Do This

Use tone mapping for perceptually and physically validated approaches to realistic image representation.

Aim for tone mapping that avoids oversaturated colors and excessive halos, maintaining a realistic impression of the scene.

Implement global tone mappers for speed and parallel processing (e.g., GPU), accepting potential loss of local detail.

Employ local tone mappers for local contrast enhancement and perceptually motivated adaptation, understanding they are slower.

Consider both global and local tone mapping approaches based on scene complexity and performance requirements.

Avoid This

Do not trivially convert radiance output directly to display RGB values, as this ignores the dynamic range problem.

Avoid simple clamping methods, as they lead to underexposed or overexposed parts of the image.

Do not confuse tone mapping with artistic contrast enhancement or over-saturation common in misused HDR photography.

Avoid creating halos around silhouettes that are not present or are exaggerated compared to the human visual system.

Do not assume tone mapping is solely an artistic decision; strive for realistic results in light simulations.

Common Questions

Tone mapping is a crucial technique in rendering and digital imaging used to compress the large dynamic range of luminance values from light simulations (high dynamic range) into a range that standard displays can reproduce (low dynamic range). This is necessary because displays have a much lower contrast ratio than the real world, and simply converting radiance to RGB would result in lost details (over/underexposure).

Topics

Tone Mapping Rendering Pipeline Radiance Dynamic Range Luminance RGB High Dynamic Range Range Compression Reinhardt Tone Mapper Global Tone Mapping Display Technology Light Simulation

Mentioned in this video

Concepts

8 bit encoding

A limitation in display technology where color channels are often encoded with 8 bits, resulting in a limited number of values (256 per channel) and an inadequate dark-to-bright ratio for realistic scenarios.

RGB

The standard color model expected by displays, which contrasts with the radiance values output by light simulations.

high dynamic range photography

A digital photography technique that combines multiple exposure images of the same scene (taken with different exposure times) to capture a wider dynamic range. It often uses similar methodologies to tone mapping but can be misused artistically.

spectral ray tracing

A method of ray tracing that traces rays carrying spectral radiance, not just radiance, allowing simulation of effects like light splitting into rainbow colors by prisms.

Software & Apps

Reinhardt tone mapper

A sophisticated and common tone mapping algorithm developed by Reinhardt, used to compress high dynamic range luminance to low dynamic range for display.

Found this useful? Build your knowledge library

Get AI-powered summaries of any YouTube video, podcast, or article in seconds. Save them to your personal pods and access them anytime.

Try Summify free