Preference Memory vs Identity Lock-In: Letting Users Change Their Minds
Preference memory becomes identity lock-in when AI treats repeated behavior as a permanent trait and stops giving users room to explore, revise, or contradict themselves.
Preference memory becomes identity lock-in when AI treats repeated behavior as a permanent trait and stops giving users room to explore, revise, or contradict themselves.
Identity-based AI coaching can connect actions to a user’s chosen sense of self, but it should keep identity provisional, editable, and subordinate to autonomy.
White Hat and Black Hat motivation provide a practical way to distinguish AI engagement that empowers users from engagement that pressures, traps, or exploits them.
AI engagement is strongest when action remains genuinely willing: users understand the recommendation, can decline it, and still feel that the system serves their goals.