World Models in Pieces: Structural Certification for General Agents
Abstract
Lay Summary
Modern AI agents are increasingly asked to complete long and complex tasks. However, an agent does not need to, and can not understand every part of the world perfectly. In many scenarios, success often depends on a few critical steps, such as choosing the right item, entering the correct page, or opening a key door. This paper studies how to identify the parts of the world that an agent truly understands well enough to rely on. We first show that expecting one agent to be uniformly reliable on all possible goals is impossible in complex environments. We then propose a certification method that tests an agent on carefully designed tasks and uses its behavior to verify whether it has an accurate internal model of specific important transitions. For the certified transitions, we prove that the agent's implied predictions closely match the real dynamics. This provides a practical way to map where an agent can be trusted, supporting safe deployment and reliable long-horizon planning for general agents.