test time compute
Concept
The computational resources and time used by a model when generating an output or 'thinking'.
Mentioned in 3 videos
Save the 3 videos on test time compute to your own pod.
Sign up free to keep building your knowledge base on test time compute as more episodes are added.
Videos Mentioning test time compute
New SEC Chair, Bitcoin, xAI Supercomputer, UnitedHealth CEO murder, with Gavin Baker & Joe Lonsdale
All-In Podcast
A new axis of scaling for AI models, suggesting that allowing models more time to think improves their IQ.
Sleep-Time Compute — Letta AI (Charles Packer, Charlie Snell, Kevin Lin)
Latent Space
The existing approach to scaling LLM compute, which focuses only on compute allocated during the inference (test) phase.
o1 - What is Going On? Why o1 is a 3rd Paradigm of Model + 10 Things You Might Not Know
AI Explained
The computational resources and time used by a model when generating an output or 'thinking'.