contamination auditor

Tool / ProductMentioned in 1 video

Automated agent used to probe for contamination in benchmarks by asking targeted questions to reveal leakage

Videos Mentioning contamination auditor

The End of SWE-Bench Verified — Mia Glaese & Olivia Watkins, OpenAI Frontier Evals

The End of SWE-Bench Verified — Mia Glaese & Olivia Watkins, OpenAI Frontier Evals

Latent Space

Automated agent used to probe for contamination in benchmarks by asking targeted questions to reveal leakage