Who is behind Figure AI and what is their mission?

Figure AI was founded in 2022 and is backed by major investors like Microsoft, NVIDIA, and Jeff Bezos. Their mission is to expand human capabilities through advanced AI, specifically by targeting the global labor shortage.

How does the Figure 1 robot actually work?

Figure 1 uses cameras and microphones to process user requests, sending transcribed text and images to an OpenAI multimodal model. The model determines the learned action, loads relevant neural network configurations, and executes the mechanical action rapidly.

What are the potential limitations or challenges with Figure 1?

There is still some latency in communication between the user and the robot, likely due to server round trips. Additionally, the robot's walking capability is not yet perfect, and concerns exist about robots learning bad habits from training data.

What other companies are developing humanoid robots for the workforce?

Competitors include Agility Robotics with their Digit robot for warehouses, Abtronic for moving goods, and Tesla with their Optimus robot. Boston Dynamics focuses more on mobility with their Atlas robot.

What is NVIDIA's role in the AI robotics race?

NVIDIA is developing Project Groot, a foundational model for humanoid robots, and provides processing hardware and software. They are also working with various robot manufacturers, including Figure AI, Boston Dynamics, and Agility Robotics.

How has the advancement of AI impacted jobs?

Unlike initial expectations that manual labor jobs would be most affected, AI has increasingly impacted cognitive jobs. Goldman Sachs estimates over 300 million jobs could be lost or diminished by AI.

When can we expect to see humanoid robots widely used in production?

While consumer availability is still distant, progress is rapid. Figure AI has already signed an agreement with BMW to test their robots in a manufacturing plant, indicating accelerating deployment timelines.

The Race For AI Robots Just Got Real (OpenAI, NVIDIA and more)

ColdFusion

Science & Technology5 min read22 min video

Mar 25, 2024|1,243,105 views|35,661|4,093

Coldfusion TV Dagogo Altraide Technology Apple Google Samsung Facebook Tesla

Save to Pod

Key Moments

TL;DR

AI-powered humanoid robots are advancing rapidly, with companies like Figure AI and Nvidia leading the race to automate labor.

Key Insights

Figure AI's humanoid robot, Figure 01, demonstrates advanced conversational abilities and task execution integrated with OpenAI's language models.

The surge in robotics development is driven by a global labor shortage, aiming to fill essential roles in warehouses, transportation, and retail.

Significant investment from major tech players like Microsoft, Nvidia, and Jeff Bezos underscores the perceived potential of humanoid robots.

Companies like Agility Robotics (Digit) and Abtronic are also developing robots for warehouse automation, with a focus on replacing human workers.

Nvidia's Project Groot aims to create a foundational model for humanoid robots, enabling natural language understanding and movement emulation through simulation.

The integration of generative AI is a key factor in enabling robots to dynamically understand and interact with their environment, moving beyond traditional hard-coded instructions.

THE EMERGENCE OF FIGURE 01

The landscape of robotics is rapidly evolving, marked by the debut of Figure AI's humanoid robot, Figure 01. Unlike previous iterations, Figure 01 can engage in natural language conversations, a significant leap attributed to its integration with OpenAI's advanced models. This development brings to life concepts once confined to science fiction, as demonstrated in the robot's ability to understand commands, process visual information, and execute tasks such as tidying a table and retrieving an item. The demo showcased an unaltered, real-time performance, highlighting the robot's capacity for independent action and reasoned responses, setting it apart from earlier robotic endeavors.

ADDRESSING THE GLOBAL LABOR SHORTAGE

Figure AI's mission is deeply rooted in addressing a critical global labor shortage. The company highlights that millions of essential jobs in warehousing, transportation, and retail remain unfilled in the United States due to a scarcity of available workers. This gap is projected to widen, pushing industries towards automation solutions. Humanoid robots, capable of thinking, learning, and safely interacting with human environments, are being positioned as the solution to bridge this deficit. Figure AI's ambition is to expand human capabilities by integrating these advanced robots into the workforce, effectively augmenting or replacing human labor where it is most needed.

SIGNIFICANT INVESTMENT AND BACKING

The credibility and potential of Figure AI are underscored by substantial investment from industry giants. Within a short period, the startup secured $70 million and more recently a remarkable $675 million, valuing the company at $2.6 billion. This influx of capital comes from prominent investors including Microsoft, NVIDIA, Jeff Bezos, and Intel Capital. Such significant backing signals strong confidence in the general-purpose humanoid robot market and Figure AI's approach. The founder, Brett Adcock, brings a proven track record from previous successful ventures, further bolstering the company's prospects in this competitive field.

TECHNOLOGY AND FUNCTIONALITY BEHIND FIGURE 01

Figure 01 operates through a sophisticated system that learns actions and behaviors rather than relying on remote operation. The robot utilizes cameras and microphones to capture audio and visual data, which are then processed by OpenAI's large multimodal models. These models interpret conversations and visual inputs to select and execute learned tasks, with a closed-loop action system. The mechanical execution is rapid, operating at 200 HZ, enabling swift micro-adjustments. This integration of multiple neural networks allows the robot to understand inputs and respond appropriately, a significant advancement in artificial intelligence for robotics.

COMPETITION AND THE WIDER ROBOTICS LANDSCAPE

The progress made by Figure AI is occurring within a highly competitive and rapidly advancing robotics sector. Companies like Agility Robotics, backed by Amazon, are deploying their Digit robots in warehouse environments, designed to perform tasks identical to human workers. Abtronic is developing robots for continuous warehouse operations, while Toyota and Honda are also investing in robotics. Tesla's Optimus robot is also making strides, though its natural language capabilities are still developing. Boston Dynamics' Atlas robot excels in agility and mobility, suggesting a diverse range of specialized humanoid robots emerging.

NVIDIA'S PROJECT GROOT AND INDUSTRY STANDARDS

NVIDIA is actively shaping the future of humanoid robots with its Project Groot, a foundational model designed for general-purpose robots. This project aims to enable robots to understand natural language, emulate human movements through observation, and learn coordination and dexterity within simulated environments using NVIDIA's Isaac Sim. The vision is for robots to seamlessly navigate, adapt, and interact with the real world. NVIDIA is collaborating with various robotics companies, suggesting the formation of an industry standard where OpenAI provides models, NVIDIA offers hardware and software, and numerous vendors supply the robot bodies.

THE IMPACT OF GENERATIVE AI AND AUTOMATION

The current advancements in robotics are largely driven by breakthroughs in generative AI. Unlike previous decades where robot instructions were painstakingly hand-coded, modern AI allows robots to dynamically perceive their environment and adapt without fixed programming. This shift is leading to the automation of automation, impacting industries and job markets significantly. While manual labor jobs were once thought to be most at risk, AI has already begun to affect cognitive roles. This transformation promises widespread changes in the next 5-10 years, potentially leading to job displacement across various sectors, as robots offer non-stop productivity without human limitations.

FUTURE IMPLICATIONS AND COLLECTIVE DECISION-MAKING

The rise of sophisticated humanoid robots presents a future filled with both opportunity and uncertainty. Questions remain about whether these robots will completely replace humans or simply alleviate us from strenuous manual tasks, allowing humans to focus on more complex endeavors. The potential military applications are also a consideration. While highly functional and affordable consumer robots are still some way off, the pace of development suggests such a future is inevitable. The collective impact on society – whether it leads to a utopia, a dystopia, or a blend of both – will depend on how humanity collectively navigates these technological advancements and makes decisions about their integration.

Mentioned in This Episode

●Products

●Software & Apps

●Companies

●Organizations

●Concepts

●People Referenced

Common Questions

Figure 1 is a humanoid robot from the startup Figure AI, notable for its ability to hold full conversations and respond to external stimuli thanks to integration with OpenAI's large multimodal models, differentiating it from robots like those by Boston Dynamics or Tesla.

Topics

Figure AI Labor Shortage Warehousing

Mentioned in this video

personBrett Adcock

Founder of Figure AI, previously founded Vety and Archer Aviation, bringing significant tech industry experience to the robotics venture.

companyAgility Robotics

The maker of the Digit robot, which is backed by Amazon and aims to replace human warehouse workers.

conceptProject Groot

A general-purpose foundational model for humanoid robots developed by NVIDIA, designed to enable understanding of natural language and emulation of human movements.

productFigure 1

A humanoid robot developed by Figure AI, capable of conversations and responding to external stimuli, integrating OpenAI's multimodal models.

productDigit

A robot made by Agility Robotics, designed for warehouse work, capable of lifting 35 lbs and entering human-designed spaces.

companyBMW Manufacturing

Has an agreement with Figure AI to test the Figure 01 robot at their plant in Spartanburg, South Carolina.

organizationIntel Capital

One of the investors in Figure AI, contributing to its substantial funding rounds.

companyVety

A previous company founded by Brett Adcock, an online talent marketplace acquired for $100 million.

softwareChatGPT voice

Used as an example of human-like imperfections in AI interactions, specifically regarding speech hesitation and natural phrasing, similar to what is seen in Figure 1.

productAbtronic

A robot designed for moving goods in warehouses, capable of working 22 hours a day and planned for deliveries starting in 2025.

productAtlas Robot

Boston Dynamics's highly agile robot, noted for its mobility and ability to perform backflips, contrasting with Figure 1's focus on dexterity for intricate tasks.