Winner's curse

In the Arena: How LMSys changed LLM Benchmarking Forever

Latent Space

A phenomenon where the performance of a selected model is overstated due to statistical fluctuations, a concern addressed by LMSys's live benchmark.