Stanford CS153 Frontier Systems | Amit Jain from Luma AI on Unified Intelligence Systems

Company focused on building unified intelligence systems, evolving from 3D capture to generative video and multimodal AI.

Company whose speaker previously discussed visual intelligence systems.

Amir Jain previously worked as an engineer at Apple on LiDAR systems for iPhones and the Vision Pro.

A 3D computer vision mapping company started by the host, which collected terabytes of 3D data from smartphone users.

A major streaming service that works with Luma and produces a large volume of content annually.

A competitor in the AI space, particularly in video and image generation with models like Gemini.

One of the largest advertising agencies in the world, acting as a deployment channel for Luma.

A gaming company producing popular games like Monopoly Go, where Luma demonstrated campaign generation capabilities.

A leading AI research lab primarily focused on large language models, which has reportedly scaled back efforts on other modalities like video generation (Sora).

The institution where the host worked when Amir Jain initially reached out for 3D data.

A compute program by A16Z that Amir Jain was an early customer of and helped name.

A car project at Apple that Amir Jain worked on before it was cancelled.

An AI image generation model that existed before Luma started exploring generative models.

A type of neural network architecture fundamental to modern AI models, comparable to differentiable training loops and gradient descent.

An app released by Luma that productionized Nerf and Gaussian Splats, gaining popularity for its results.

Luma's first generative video model, released in March 2024, which attracted 6 million users in its first few weeks.

The technology used to produce significant portions of the show 'Old Stories', capable of modeling world physics, light, and fluid interactions.

The Luma model used to create the presentation slides, demonstrating unified intelligence capabilities.

Vision Language Models that can understand images but cannot generate them, representing a gap Luma aims to bridge.

Models that are good at generating images but lack understanding, contrasted with Luma's unified approach.

Google's AI models that show capability in video and image generation.

OpenAI's video generation model, the subject of speculation about its cancellation and market impact.

A creative tool used as an analogy for how generative AI doesn't absolve users of copyright responsibility.

A programming language mentioned as an example of a more efficient but less popular choice compared to Python.

A programming language presented as the popular choice, even if not the most efficient, used as an analogy for AI research trends.

Large Language Models, which are currently seen as highly intelligent and useful, a benchmark Luma aims for other modalities to reach.

Venture capital firm where the host was a general partner and where Amir Jain was an early customer of their compute program, Oxygen.

Laser imaging, detection, and ranging technology used in Apple's Jasper sensor for iPhones and the Vision Pro.

A LiDAR system developed at Apple that is now part of iPhones.

Apple's mixed-reality headset, which Amir Jain started working on after Project Titan was cancelled.

The announcement of this GPU architecture in 2023 prompted Luma to start building foundations for generative video.

GPUs currently used by Luma for training their models.

A major streaming studio that works with Luma, requiring strict data privacy.

The second-largest brand globally, moving significant annual content production to Luma.

A neural rendering technique that had already been developed by Matthew Tanchik from Berkeley when Luma began exploring generative systems.

A method for 3D reconstruction that was productionized by Luma in their 3D capture app.

Generative Adversarial Networks, a technique used for a time but considered finicky; still useful for distillation and real-time systems but less scalable than transformers.

Researcher from Berkeley who developed Nerf, and later joined Luma's team.

The star actor in the upcoming Prime Video show 'Old Stories'.

Archduke whose assassination is part of a hypothetical scenario discussing the causes of World War I.

Mentioned in relation to the movie 'Hillmary', highlighting that it's Hollywood's job to make content that audiences want to watch.

Streaming service where a new show, 'Old Stories', produced using Luma agents, will be released.

A new show on Prime Video about Moses, with a significant portion produced using Luma agents.

A character/franchise that Luma guarantees will not appear in training data for sensitive studio projects.

A popular game produced by Savvy Games, used as a case study for Luma's campaign generation.

A copyrighted character that illustrates the difference between ease of production and legal copyright adherence.

A movie referenced to make a point about audience responsibility and Hollywood's role in creating compelling content.

Digital Millennium Copyright Act, under which Luma would take down content if a notice is received.