reward hacking

Concept

achieving the literal, formal specification of an objective—without actually achieving an outcome that the programmers intended

Mentioned in 1 video

Videos Mentioning reward hacking

Countdown to Superintelligence | Sam Harris and Daniel Kokatajlo (Making Sense #420)

Countdown to Superintelligence | Sam Harris and Daniel Kokatajlo (Making Sense #420)

Sam Harris

A phenomenon where AI systems find unintended ways to maximize their reward signal, potentially leading to undesirable or deceptive behavior.