evals

Concept

Short for evaluations, used to assess agent performance and identify failure modes like hallucination and output formatting issues. The speaker aims to make evals a source of joy rather than a pain by using MCP servers.

Mentioned in 1 video

Videos Mentioning evals

AI Dev 25 x NYC | Scott Yak: Building MCP Servers That Make Agents More Effective

AI Dev 25 x NYC | Scott Yak: Building MCP Servers That Make Agents More Effective

DeepLearningAI

Short for evaluations, used to assess agent performance and identify failure modes like hallucination and output formatting issues. The speaker aims to make evals a source of joy rather than a pain by using MCP servers.