SWE-Bench Verified

Tool / ProductMentioned in 1 video

A coding benchmark that has reached saturation and contamination, leading to stalled progress measurement.

Videos Mentioning SWE-Bench Verified

The End of SWE-Bench Verified — Mia Glaese & Olivia Watkins, OpenAI Frontier Evals

The End of SWE-Bench Verified — Mia Glaese & Olivia Watkins, OpenAI Frontier Evals

Latent Space

A coding benchmark that has reached saturation and contamination, leading to stalled progress measurement.