Noam Shazeer
Person
Former Google employee who invented Transformers and started Character.ai after being frustrated with inability to launch projects at Google.
Mentioned in 4 videos
Videos Mentioning Noam Shazeer

The 10,000x Yolo Researcher Metagame — with Yi Tay of Reka
Latent Space
Credited as the single author of the SWIGLU paper and a co-author on a paper exploring Transformer modifications, influencing Transformer architecture choices.

Why Google failed to make GPT-3 -- with David Luan of Adept
Latent Space
A researcher at Google who discussed trillion-parameter models in 2017.

Winning the AI Race Part 1: Michael Kratsios, Kelly Loeffler, Shyam Sankar, Chris Power
All-In Podcast
Former Google employee who invented Transformers and started Character.ai after being frustrated with inability to launch projects at Google.

Stanford CS336 Language Modeling from Scratch | Spring 2026 | Lecture 4: Attention Alternatives
Stanford Online
An author of an early Mixture of Experts paper, introducing stochastic routing approximations.