test time compute
Concept
The computational resources and time used by a model when generating an output or 'thinking'.
Mentioned in 3 videos
Videos Mentioning test time compute
New SEC Chair, Bitcoin, xAI Supercomputer, UnitedHealth CEO murder, with Gavin Baker & Joe Lonsdale
All-In Podcast
A new axis of scaling for AI models, suggesting that allowing models more time to think improves their IQ.
Sleep-Time Compute — Letta AI (Charles Packer, Charlie Snell, Kevin Lin)
Latent Space
The existing approach to scaling LLM compute, which focuses only on compute allocated during the inference (test) phase.
o1 - What is Going On? Why o1 is a 3rd Paradigm of Model + 10 Things You Might Not Know
AI Explained
The computational resources and time used by a model when generating an output or 'thinking'.