Adaptive Cognitive Orthotics: Combining Reinforcement Learning and Constraint-Based Temporal Reasoning
Matthew Rudary - University of Michigan Satinder Singh - University of Michigan Martha Pollack - University of Michigan
Reminder systems support people with impaired prospective memory and/or executive function, by providing them with reminders of their functional daily activities. We integrate temporal constraint reasoning withreinforcement learning (RL) to build an adaptive reminder system and in asimulated environment demonstrate that it can personalize to a user and adaptto both short- and long-term changes. In addition to advancing the applicationdomain, our integrated algorithm contributes to research on temporal constraint reasoning by showing how RL can select an optimal policy from amongst a set of temporally consistent ones, and it contributes to the work on RL by showing how temporal constraint reasoning can be used to dramatically reduce the space of actions from which an RL agent needs to learn.