Weak-to-strong generalization

ConceptMentioned in 1 video

An OpenAI paper discussing how to make a weaker model (e.g., GPT-2) smarter by using a stronger one (e.g., GPT-4), relevant to superalignment and controlling future superintelligence.

Videos Mentioning Weak-to-strong generalization

The Origin and Future of RLHF: the secret ingredient for ChatGPT - with Nathan Lambert

The Origin and Future of RLHF: the secret ingredient for ChatGPT - with Nathan Lambert

Latent Space

An OpenAI paper discussing how to make a weaker model (e.g., GPT-2) smarter by using a stronger one (e.g., GPT-4), relevant to superalignment and controlling future superintelligence.