Key Moments

Why Every Agent needs Open Source Cloud Sandboxes

Latent Space PodcastLatent Space Podcast
Science & Technology5 min read67 min video
Apr 24, 2025|2,527 views|40
Save to Pod
TL;DR

E2B provides open-source cloud sandboxes for AI agents, enabling complex tasks like data analysis and code execution, and is evolving into a comprehensive AI cloud platform.

Key Insights

1

E2B offers open-source cloud sandboxes that act as a runtime environment for AI agents, enabling them to execute code, analyze data, and perform complex tasks.

2

The sandboxes have evolved from a simple code interpreter to a general-purpose 'dev box' for AI, supporting various use cases like data analysis, code generation, and research.

3

E2B experienced significant growth, moving from 40,000 sandboxes in March 2024 to 50 million in March 2025, indicating a strong market pull for AI infrastructure.

4

The company emphasizes a strong developer experience (DX) and aims to be the 'Kubernetes for agents' with a focus on ease of use and generality.

5

E2B is expanding its offerings beyond basic Linux sandboxes to include features like GPU support and potentially Windows environments for broader AI applications.

6

The platform supports LLM training and reinforcement learning, as demonstrated by its use in Hugging Face's Open R1 project, offering a cost-effective alternative to GPU clusters.

7

E2B is exploring more advanced features like sandboxing for reinforcement learning, computer vision tasks, and potentially forking and checkpointing to support complex agentic workflows.

FROM DEV TOOLS TO AI SANDBOXES

Vasek Mlejnsky, co-founder of E2B, shares the company's origin story, stemming from an interest in developer tools and interactive documentation. Their initial product, DevBook, featured interactive playgrounds built on a sandbox infrastructure. This technology, though unscalable, became the foundation for E2B. A pivot occurred in early 2023 with the advent of improved LLMs like GPT-3.5, leading them to focus on sandboxes as essential environments for AI agents to run code and automate tasks.

THE EXPLOSION OF AI AGENT USE CASES

E2B's sandboxes have rapidly evolved to support a wide array of AI agent capabilities. Initially envisioned for code interpretation and data analysis, they now facilitate deep research, code generation, and even more complex tasks like reinforcement learning and computer vision. The platform's versatility allows for a generalized runtime environment, akin to a 'dev box' for AI, enabling agents to perform tasks that mirror human actions on a computer, such as creating files, analyzing data, or writing applications.

MASSIVE GROWTH AND SCALABILITY CHALLENGES

The demand for E2B's sandboxes has been astronomical, with usage soaring from 40,000 sandboxes in March 2024 to 15 million in March 2025. This exponential growth highlights a critical infrastructure gap in the AI ecosystem. E2B positions itself as an 'LLM OS' company, providing the underlying infrastructure that agents leverage. The company emphasizes a superior developer experience (DX), aiming to be the intuitive and accessible 'Kubernetes for agents'.

BEYOND CODE INTERPRETATION: A GENERAL RUNTIME

E2B's sandboxes are more than just code interpreters; they function as a general runtime for LLMs and agents. This means they can handle diverse tasks, from simple data transformation and analysis to complex operations like creating spreadsheets or running entirely new applications. The platform treats the sandbox as a general-purpose machine, capable of running various programming languages and even enabling agents to start servers accessible from the internet, thus offering comprehensive utility similar to any developer's workstation.

SUPPORTING AI DEVELOPMENT AND TRAINING

E2B plays a crucial role in the AI development lifecycle, from model training to agent evaluation. Hugging Face utilizes E2B sandboxes for the reinforcement learning phase of their Open R1 model, enabling massive parallelization of training steps and offering a cost-effective alternative to expensive GPU clusters. The sandboxes provide isolated environments, mitigating risks associated with LLMs altering cluster permissions and ensuring secure, efficient training operations.

ADVANCED FEATURES AND FUTURE HORIZONS

Looking ahead, E2B is focused on expanding its capabilities to include GPU support for more demanding AI tasks, and potentially Windows environments for broader compatibility. The platform is also developing advanced features like forking and checkpointing to support complex agentic workflows, such as parallel problem-solving and tree searches. Ultimately, E2B envisions itself as the future AWS for LLMs, providing elastic and comprehensive cloud infrastructure for AI development and deployment.

NAVIGATING THE AI INFRASTRUCTURE LANDSCAPE

E2B positions itself as a generalist sandbox provider, catering to AI engineers rather than traditional infrastructure engineers. While competitors might focus on specific aspects like browser emulation or custom Python sandboxes, E2B offers broad utility. Educating the market on the potential of these sandboxes has been key, moving from specific use cases like code interpretation to demonstrating the full spectrum of possibilities for AI agents, fostering innovation and adoption.

THE COMPLEXITY OF PRICING AND BILLING

The transition to usage-based billing, common in infrastructure, presents E2B with challenges, particularly in accurately pricing diverse workloads. While starting with simple pricing models is appealing, the reality of scaling involves handling unpredictable usage patterns and resource demands. E2B is evaluating third-party billing providers like Orb and Metronome to manage this complexity, aiming to accurately account for compute, storage, and networking in their evolving pricing structures.

THE EVOLVING ROLE OF LLM FRAMEWORKS AND PROTOCOLS

The AI landscape is seeing the rise of various frameworks and protocols, like Langchain and MCP (Machine Computation Protocol). E2B integrates with these to enhance agent capabilities and interoperability. The company believes in providing foundational tools rather than opinionated frameworks, allowing developers flexibility. The MCP, while promising, still faces questions regarding its integration, particularly for remote servers and higher-order applications, with E2B exploring how to best support these emerging standards.

DISTINGUISHING HUMANS AND AGENTS ONLINE

As AI agents proliferate, the distinction between human and agent traffic online becomes critical. E2B notes the significant increase in agent-generated traffic versus human traffic, highlighting the need for websites to adapt. While efforts like LLM.txt aim to improve LLM legibility, E2B suggests a dualistic approach, envisioning separate human and agent-facing internet experiences to manage incentives and user experience effectively.

THE MIGRATION TO SAN FRANCISCO

Relocating to San Francisco was a strategic move for E2B, driven by the city's emergence as an AI hub. This proximity to users facilitated 'collision installations'—deeply embedding with early customers to rapidly iterate and refine the product based on direct feedback. While building a dev tool company from anywhere is possible, proximity to a concentrated user base accelerated E2B's understanding of user needs and product development, especially in the early, highly iterative stages.

RECRUITING TALENT & FUTURE GROWTH

E2B is actively hiring for roles in distributed systems, platform engineering, AI engineering, account management, and customer success. The company highlights the wealth of talent in Europe, particularly in the Czech Republic, but also emphasizes the strategic importance of its San Francisco presence for customer relations and sales. With a clear roadmap and strong market momentum, E2B aims to accelerate its growth, viewing its current position as a spark it wants to fan into a fire.

E2B Sandbox Usage Growth

Data extracted from this episode

Time PeriodNumber of Sandboxes
March 202440,000
March 202515 million

Common Questions

E2B originated from Vic and Thomas's experience with DevBook, an interactive documentation tool. After facing burnout and seeing the potential of GPT-3.5, they pivoted to explore AI agents and developed E2B, initially focusing on automating their own work with developer sandboxes.

Topics

Mentioned in this video

More from Latent Space

View all 85 summaries

Found this useful? Build your knowledge library

Get AI-powered summaries of any YouTube video, podcast, or article in seconds. Save them to your personal pods and access them anytime.

Try Summify free