Teacher Forcing

Concept

A training technique discussed in the context of Llama 3, related to reconciling supervised fine-tuning and RLHF.

Mentioned in 1 video

Videos Mentioning Teacher Forcing

Training Llama 2, 3 & 4: The Path to Open Source AGI — with Thomas Scialom of Meta AI

Training Llama 2, 3 & 4: The Path to Open Source AGI — with Thomas Scialom of Meta AI

Latent Space

A training technique discussed in the context of Llama 3, related to reconciling supervised fine-tuning and RLHF.