SweBench

Software / App

A benchmark mentioned for its approach of starting from real GitHub data and working towards a goal, seen as analogous to an integration test.

Mentioned in 1 video

Videos Mentioning SweBench

Fullstack-Bench: The Eval for Coding Agents — with Sujay Jayakar, Chief Scientist, Convex

Fullstack-Bench: The Eval for Coding Agents — with Sujay Jayakar, Chief Scientist, Convex

Latent Space

A benchmark mentioned for its approach of starting from real GitHub data and working towards a goal, seen as analogous to an integration test.