Dagger

The Magic of LLM Distillation — Rishabh Agarwal, Google DeepMind

Latent Space

An algorithm from RL that addresses the train-test mismatch by having the learner query the teacher for feedback on its own generated data samples.