Open-ended design decisions

ConceptMentioned in 1 video

A capability that ideal coding benchmarks should measure, where models make reasonable choices in underspecified problems.

Videos Mentioning Open-ended design decisions

The End of SWE-Bench Verified — Mia Glaese & Olivia Watkins, OpenAI Frontier Evals

The End of SWE-Bench Verified — Mia Glaese & Olivia Watkins, OpenAI Frontier Evals

Latent Space

A capability that ideal coding benchmarks should measure, where models make reasonable choices in underspecified problems.