Skip to yearly menu bar Skip to main content


Oral Talk
in
Workshop: Workshop on Theory of Mind in Communicating Agents

Between prudence and paranoia: Theory of Mind gone right, and wrong

Nitay Alon · Lion Schulz · Peter Dayan · Joseph Barnby

Keywords: [ ToM ] [ theory of mind ] [ IPOMDP ] [ deception ] [ Paranoia ] [ Planning ] [ mixed motive ] [ Cognitive hierarchy ]


Abstract:

Agents need to be on their toes when interacting with competitive others to avoid being duped. Too much vigilance out of context can, however, be detrimental and produce paranoia. Here, we offer a formal account of this phenomenon through the lens of theory of mind. We simulate agents of different depths of mentalization and show how, if aligned well, deep recursive mentalisation gives rise to both successful deception as well as reasonable skepticism. However, we also show how, if theory of mind is too sophisticated, agents become paranoid, losing trust and reward in the process. We discuss our findings in light of computational psychiatry and AI safety.

Chat is not available.