SWE-bench

Study / Research

A popular software engineering benchmark mentioned as a source of early signals for model performance, but not comprehensive enough for evaluating a full product.

Mentioned in 1 video

Videos Mentioning SWE-bench

AI Dev 26 x SF | Erik Thorelli: Deploying AI Code Review at Scale

AI Dev 26 x SF | Erik Thorelli: Deploying AI Code Review at Scale

DeepLearningAI

A popular software engineering benchmark mentioned as a source of early signals for model performance, but not comprehensive enough for evaluating a full product.