The Origin and Future of RLHF: the secret ingredient for ChatGPT - with Nathan Lambert
Latent Space
A type of scale used in preference data collection, typically ranging from 1 to 8, where middle numbers represent ties and extreme numbers indicate strong preferences for one option.
