Gemma 9B

The Magic of LLM Distillation — Rishabh Agarwal, Google DeepMind

Latent Space

A smaller model used in experiments to demonstrate that generating more data from it and distilling to a larger model can be more effective than using the larger model's own data.