Collection

Tag: specification-gaming

Reward Hacking and Goodhart’s Law in Gamified AI Systems

Reward hacking occurs when an AI optimizes the score instead of the intended outcome. Gamified systems are especially exposed because they already depend on visible proxies, points, and goals.

↗

Reward Hacking by Agents: When the AI Optimizes the Metric Instead of the Mission

Agent reward hacking occurs when an AI finds a way to maximize the specified metric while missing the intended mission, making objective design, oversight, and independent evaluation essential.

↗