Gemma 9B

Software / App

A smaller model used in experiments to demonstrate that generating more data from it and distilling to a larger model can be more effective than using the larger model's own data.

Mentioned in 1 video

Videos Mentioning Gemma 9B

The Magic of LLM Distillation — Rishabh Agarwal, Google DeepMind

The Magic of LLM Distillation — Rishabh Agarwal, Google DeepMind

Latent Space

A smaller model used in experiments to demonstrate that generating more data from it and distilling to a larger model can be more effective than using the larger model's own data.