Sciweavers

IAT
2010
IEEE

Selecting Operator Queries Using Expected Myopic Gain

13 years 10 months ago
Selecting Operator Queries Using Expected Myopic Gain
When its human operator cannot continuously supervise (much less teleoperate) an agent, the agent should be able to recognize its limitations and ask for help when it risks making autonomous decisions that could significantly surprise and disappoint the operator. Inspired by previous research on making exploration-exploitation tradeoff decisions and on inverse reinforcement learning, we develop Expected Myopic Gain (EMG), a Bayesian approach where an agent explicitly models its uncertainty and how possible operator responses to queries could improve its decisions. With EMG, an agent can weigh the relative expected utilities of seeking operator help versus acting autonomously. We provide conditions under which EMG is optimal, and preliminary empirical results on simple domains showing that EMG can perform well even when its optimality conditions are violated. Keywords- Human-robot/agent Interaction, Planning, Value of Information
Robert Cohn, Michael Maxim, Edmund H. Durfee, Sati
Added 11 Feb 2011
Updated 11 Feb 2011
Type Journal
Year 2010
Where IAT
Authors Robert Cohn, Michael Maxim, Edmund H. Durfee, Satinder Singh
Comments (0)