How does Grock aim to solve the agent orchestration problem?

Grock focuses on significantly improving inference speed (10-40x faster) through its custom LPU silicon and a unified API, aiming to reduce latency and enable more complex, faster AI agents.

What are Grock's Compound AI Systems?

These are server-side solutions built on open-source models that integrate multiple tools like web search, code execution, and browser automation, accessible through a single API call without manual orchestration.

How can I try using Grock's services?

You can visit console.grock.com to create a free account. They offer a generous free tier with millions of tokens per day and provide Python and JavaScript SDKs to integrate into your applications.

What is the difference between Grock Compound and Grock Compound Mini?

Grock Compound can call multiple tools simultaneously, making it powerful for complex tasks. Grock Compound Mini executes one tool at a time, offering a simpler approach.

How does Grock handle web search?

Grock integrates with existing web search providers like Brave Search, selecting the best ones based on latency, privacy, and cost. Users can also customize by including or excluding specific domains.

Can Grock be integrated with other AI workflow tools?

Yes, Grock aims for open compatibility. While native integrations exist for platforms like Langflow, you can often use Grock by replacing your existing API key (e.g., OpenAI's) with Grock's key in supported low-code/no-code tools.

What are Grock's future plans for tooling?

Grock plans to introduce MCP server support soon, allowing users to bring their own tools and MCP servers for further customization of their agent workflows.

Key Moments

AI Dev 25 x NYC | Hatice Ozen: Build a Deep Research Agent with One API Call

DeepLearning.AI

Education3 min read31 min video

Dec 4, 2025|844 views|14

Save to Pod

Key Moments

TL;DR

Build a deep research AI agent with one API call using Groq's compound system.

Key Insights

Traditional AI agents are complex to build, requiring manual orchestration of state, tool routing, error handling, and multiple LLM calls, leading to latency issues.

LLMs are limited by their static training data, necessitating access to real-time information through tools like web search or code execution.

Groq offers a 'compound AI system' allowing for a deep research agent with a single API call, integrating tools like web search and code execution server-side.

Groq's LPU (Language Processing Unit) is custom-built silicon designed for AI inference, offering significantly faster speeds compared to traditional GPUs.

The Groq console provides an open-compatible API, a generous free tier, and the ability to easily switch from existing APIs like OpenAI by changing the base URL and model ID.

The compound system simplifies agent development by handling tool selection, testing, and orchestration internally, reducing latency and complexity for developers.

THE AGENT ORCHESTRATION PROBLEM

Building AI agents today is a complex endeavor, often requiring developers to manage conversational state across multiple LLM calls, manually route between various tools, handle error conditions, and coordinate external API integrations. This intricate process introduces significant latency at every step, making agents slow and potentially unusable for real-time applications. The need for efficient, low-latency agents is paramount for user experience, especially in high-frequency tasks like trading, customer service, and coding.

THE ROLE OF LLMS AND EXTERNAL TOOLS

Large Language Models (LLMs) are powerful but inherently limited by their static training data, meaning they lack real-time knowledge. To overcome this, LLMs need to be equipped with tools or functions that grant them access to external APIs, databases, and current information. This allows LLMs to provide up-to-date answers rooted in real-time data, moving beyond simple chatbot functionalities to more sophisticated applications like research and analysis.

INTRODUCING GROQ AND THE LPU

Groq, distinct from Elon Musk's Grok, is a company founded with the vision of accelerating AI inference. Their core innovation is the custom-built LPU (Language Processing Unit), a specialized silicon architecture designed to deliver significantly faster AI inference speeds compared to traditional GPUs. This hardware advantage is key to reducing the latency that plagues current AI agent workflows. Groq's platform is open-compatible, supporting both open-source and closed-source models.

GROQ'S COMPOUND AI SYSTEM

Groq's 'compound AI system' aims to drastically simplify the creation of sophisticated AI agents, particularly for deep research. Instead of developers manually orchestrating multiple LLM calls and tool executions, Groq offers a server-side solution where a single API call can invoke a complex reasoning process. This system integrates essential tools like web search and code execution, with Groq's team handling the selection, testing, and optimization of the best available tools behind the scenes.

BUILDING A DEEP RESEARCH AGENT

The workshop demonstrated how to build a deep research agent that rivals existing services like Perplexity with just one API call to Groq. By using a specific model ID like 'Grok-compound' or 'Grok-compound-mini' and switching out API keys and base URLs in existing code, developers can immediately benefit from Groq's accelerated inference. This approach eliminates the need for developers to manage orchestration, tool selection, or latency concerns, providing a ready-to-use, high-performance research agent.

ACCESSIBILITY AND CUSTOMIZATION

Groq provides a user-friendly console with extensive documentation, a playground for experimentation, and a generous free tier offering millions of tokens daily. For developers seeking more control, the compound system allows customization through 'include domain' and 'exclude domain' parameters, enabling tailored research agents. Groq also supports many integrations with popular low-code/no-code platforms and plans to extend tooling with MCP server support for even greater customization.

Mentioned in This Episode

●Products

●Software & Apps

●Companies

●Concepts

Common Questions

The primary challenge is agent orchestration, involving managing conversation state, routing tools manually, handling errors, coordinating APIs, and battling latency, which often makes agents unusable for users expecting fast responses.