Key Moments
A Live Motion Portable 3D Video Camera
Google TalksWant to know something specific about what's covered?
We've already dissected every moment. Ask and we will deliver (with timestamps).
Key Moments
A new flash LADAR camera can capture 3D video at 30 frames per second, but its current prototype is expensive at $1M and weighs 12 pounds.
Key Insights
The camera uses a 1.57um eye-safe laser and a 128x128 pixel focal plane array to capture 500,000 range points per second.
Unlike scanning systems, this camera captures 3D data from multiple pixels simultaneously, enabling it to see moving objects like birds and rockets.
The system can zoom like a conventional optical system and demonstrated range precision of approximately 11.5 inches at one kilometer.
The core of the camera is a readout integrated circuit (ROIC) with unit cells containing analog and digital functions, including counters to measure time-of-flight.
The technology can be adapted for different environments by changing the detector array, such as using a silicon detector for underwater imaging.
Current applications are primarily government and military contracts, including surveillance, collision avoidance, and robot vision.
Revolutionary 3D video capture with flash LADAR
Advanced Scientific Concepts (ASC) has developed a novel 3D camera system utilizing flash LADAR (Laser Radar) technology. Unlike traditional 2D cameras that use a flash bulb, this camera employs a laser pulse to capture depth information. The system's key innovation is its ability to simultaneously measure the distance to every point in a scene at video frame rates (30Hz). This is achieved through a solid-state flash LADAR system that records the time-of-flight of a laser pulse, collecting approximately 500,000 range points per second. The camera uses a 1.57 um eye-safe laser, making it safe for use in various environments without posing a risk to human eyes. ASC's approach is unique as they design and fabricate their sensors from the integrated circuit level up, including custom lasers, optics, and mechanical systems, because off-the-shelf components were insufficient for their needs.
Simultaneous multi-pixel data capture surpasses scanning limitations
A significant advantage of ASC's 3D camera over existing laser scanning systems is its ability to capture depth data from multiple pixels concurrently, rather than scanning pixel by pixel. For its 128x128 pixel focal plane array, this means generating 3D data from 16,384 pixels at 30 frames per second, resulting in 491,520 pixels per second. Traditional scanners are considerably slower. This simultaneous capture is crucial for dynamic environments, as it allows the camera to accurately record moving objects such as birds in flight or rockets. Furthermore, unlike scanners that struggle with motion during the scanning process, this system can account for moving vehicles or objects. The camera also retains conventional optical zoom capabilities, similar to 2D cameras, adding to its versatility.
Exceptional detail and measurement capabilities
The output from the 3D camera provides a wealth of information beyond what is visible in a standard 2D image. Images can achieve a range precision of approximately 11.5 inches at a distance of one kilometer, allowing for precise measurements. An example demonstrated showed a visible image alongside the rich 3D data, revealing greater detail and depth. This 3D data can be textured with visible CCD camera imagery to create visually comprehensive representations. The ability to measure distances and contours from a single vantage point opens up numerous applications where detailed spatial understanding is critical. The system's current prototype, while capable, is a first-generation device, with significant potential for miniaturization and improved performance.
Core technology: The readout integrated circuit
The heart of the camera's 3D focal plane is a custom-designed readout integrated circuit (ROIC) combined with a detector array. Each unit cell within the ROIC integrates both analog and digital circuitry. This includes a digital counter that begins timing when the laser pulse is emitted and stops when the return pulse is detected, precisely measuring the time-of-flight. Simultaneously, analog circuitry captures the pulse shape, providing high-resolution imaging details. This architecture allows for flexibility; by swapping the detector array, the camera can be adapted for different wavelengths and environments. For instance, an Indium Gallium Arsenide detector is used for the 1.57 um laser, while a silicon detector could be employed for underwater imaging where blue-green light penetrates water effectively.
Advanced operational modes for challenging environments
The camera's design incorporates sophisticated modes to handle challenging conditions. The hard target mode fires a broad pulse to capture reflections from an entire scene. Crucially, the system can be programmed to suppress initial reflections (e.g., from a net) and focus on returns from specific depths (e.g., behind the net), enabling it to 'see through' obscurations. This capability is vital for penetrating smoke, fog, or dense particulates, and even for seeing into water. It achieves this by effectively range-gating, which can be selectively activated to ignore foreground objects and capture targets at a desired distance. This is particularly useful for applications requiring visibility in adverse weather or through visual obstructions.
Form factor and future potential for miniaturization
The current prototype camera weighs 12 pounds, with a significant portion of that weight attributed to the optics (a 5-pound lens) and the cooling system for the laser. However, the company emphasizes that this is just the first prototype, and considerable miniaturization is possible. By reducing the range of operation, for example, from one kilometer to half a kilometer, the size, weight, and power requirements can be reduced by roughly a factor of four. Future versions are envisioned to be much smaller and lighter, potentially fitting into compact form factors. This is achieved through continued integration of custom chips, more efficient lasers, and optimized optics, with the ultimate goal of creating highly compact and portable 3D imaging systems.
Diverse applications, particularly in defense and surveillance
While the technology is versatile, current applications are heavily driven by government and military contracts. These include surveillance, where the camera can provide real-time 3D mapping of scenes for tactical teams; collision avoidance systems for vehicles; projectile detection; and robot vision. Its ability to capture motion and compute trajectories from successive frames makes it valuable for tracking and analyzing dynamic events. The system's robustness in obscuring conditions also makes it suitable for reconnaissance and situational awareness in environments where visibility is limited. Potential civilian applications, such as automotive safety and industrial inspection, are also acknowledged, though currently less developed.
Data handling and future development
The camera generates a significant amount of data, producing approximately one gigabyte per minute in its raw dump format, which includes 20 slices of information. This data can be reduced by an order of magnitude by integrating the 3D algorithm directly into the camera's gate array, potentially bringing it down to 100 megabytes per minute. Further lossless compression could reduce this by another factor of two. While the current software is in its early stages (less than alpha), the company is actively developing more advanced visualization techniques and refining the algorithms. Future efforts will focus on delivering even more compact, efficient, and user-friendly 3D imaging systems by enhancing hardware, improving data processing, and exploring new applications.
Mentioned in This Episode
●Products
●Companies
●Organizations
●People Referenced
Common Questions
A 3D flash LADAR camera uses laser pulses, similar to how a 2D camera uses a flashbulb, to create three-dimensional images. It emits a laser pulse that reflects off an object, and the returned signal is collected to build a 3D representation of the scene.
Topics
Mentioned in this video
More from GoogleTalksArchive
View all 48 summaries
58 minEverything is Miscellaneous
54 minStatistical Aspects of Data Mining (Stats 202) Day 7
45 minKey Phrase Indexing With Controlled Vocabularies
63 minMysteries of the Human Genome
Ask anything from this episode.
Save it, chat with it, and connect it to Claude or ChatGPT. Get cited answers from the actual content — and build your own knowledge base of every podcast and video you care about.
Get Started Free