Timezone: »

 
Poster
A Framework for Learning to Request Rich and Contextually Useful Information from Humans
Khanh Nguyen · Yonatan Bisk · Hal Daumé III

@ None #None

When deployed, AI agents will encounter problems that are beyond their autonomous problem-solving capabilities. Leveraging human assistance can help agents overcome their inherent limitations and robustly cope with unfamiliar situations. We present a general interactive framework that enables an agent to determine and request contextually useful information from an assistant, and to incorporate rich forms of responses into its decision-making process. We demonstrate the practicality of our framework on a simulated human-assisted navigation problem. Aided with an assistance-requesting policy learned by our method, a navigation agent achieves up to a 7× improvement in success rate on tasks that take place in previously unseen environments, compared to fully autonomously behavior. We show that the agent can take advantage of different types of information depending on the context, and analyze the benefits and challenges of learning the assistance-requesting policy when the assistant can recursively decompose tasks into subtasks.

Author Information

Khanh Nguyen (University of Maryland)
Yonatan Bisk (Carnegie Mellon University)
Hal Daumé III (Microsoft Research / University of Maryland)

Related Events (a corresponding poster, oral, or spotlight)

More from the Same Authors