Bradley-Terry model
Concept
A statistical model used to estimate the relative strengths of competing items based on pairwise comparisons, applied by LMSys for ELO score calculation.
Mentioned in 2 videos
Videos Mentioning Bradley-Terry model
In the Arena: How LMSys changed LLM Benchmarking Forever
Latent Space
A statistical model used to estimate the relative strengths of competing items based on pairwise comparisons, applied by LMSys for ELO score calculation.
The Origin and Future of RLHF: the secret ingredient for ChatGPT - with Nathan Lambert
Latent Space
A model from the 1950s used for pairwise preferences, which underlies how RLHF works by comparing two completions and determining which is better.