reward hacking
Concept
achieving the literal, formal specification of an objective—without actually achieving an outcome that the programmers intended
Mentioned in 2 videos
Save the 2 videos on reward hacking to your own pod.
Sign up free to keep building your knowledge base on reward hacking as more episodes are added.
Videos Mentioning reward hacking
Countdown to Superintelligence | Sam Harris and Daniel Kokatajlo (Making Sense #420)
Sam Harris
A phenomenon where AI systems find unintended ways to maximize their reward signal, potentially leading to undesirable or deceptive behavior.
What Frontier Labs Buy: A Data Deep Dive with Handshake AI — Garrett Lord & Team
Latent Space
A phenomenon where an AI agent exploits loopholes in its reward system to achieve a goal in an unintended or undesirable way.