Mentioned as having a very low active parameter count (around 3%), indicating high sparsity.
Latent Space
