LM as a Judge

Concept

A methodology explored by LMSys to use LLMs themselves to judge or evaluate other LLMs, aiming for automated high-quality signals.

Mentioned in 1 video

Videos Mentioning LM as a Judge

In the Arena: How LMSys changed LLM Benchmarking Forever

In the Arena: How LMSys changed LLM Benchmarking Forever

Latent Space

A methodology explored by LMSys to use LLMs themselves to judge or evaluate other LLMs, aiming for automated high-quality signals.