InstructGPT
A precursor to ChatGPT developed with OpenAI, which became a significant turning point for Scale AI.
Save the 4 videos on InstructGPT to your own pod.
Sign up free to keep building your knowledge base on InstructGPT as more episodes are added.
Videos Mentioning InstructGPT
The REAL potential of generative AI
Y Combinator
A model developed by OpenAI that, despite being smaller, showed significant preferred performance over larger models when instruction-tuned and using Reinforcement Learning from Human Feedback (RLHF).
The Origin and Future of RLHF: the secret ingredient for ChatGPT - with Nathan Lambert
Latent Space
An OpenAI model that demonstrated the three-step RLHF process and produced 'incredibly pretty plots' of performance improvement. It tried to match the instruction tuning model to constrain the distribution.
Beating GPT-4 with Open Source Models - with Michael Royzen of Phind
Latent Space
An earlier version of the GPT models fine-tuned to follow instructions, mentioned as a predecessor to advanced instruction-tuned models.
Alexandr Wang: Building Scale AI, Transforming Work With Agents & Competing With China
Y Combinator
A precursor to ChatGPT developed with OpenAI, which became a significant turning point for Scale AI.