Tag: goodharts-law

Reward hacking occurs when an AI optimizes the score instead of the intended outcome. Gamified systems are especially exposed because they already depend on visible proxies, points, and goals.

When users can earn status or rewards from an AI-generated score, they will learn the scoring rule; robust design assumes strategic adaptation and rewards evidence the metric cannot cheaply fake.