Sciweavers

Share
AAAI
2006

Reinforcement Learning with Human Teachers: Evidence of Feedback and Guidance with Implications for Learning Performance

9 years 5 months ago
Reinforcement Learning with Human Teachers: Evidence of Feedback and Guidance with Implications for Learning Performance
As robots become a mass consumer product, they will need to learn new skills by interacting with typical human users. Past approaches have adapted reinforcement learning (RL) to accept a human reward signal; however, we question the implicit assumption that people shall only want to give the learner feedback on its past actions. We present findings from a human user study showing that people use the reward signal not only to provide feedback about past actions, but also to provide future directed rewards to guide subsequent actions. Given this, we made specific modifications to the simulated RL robot to incorporate guidance. We then analyze and evaluate its learning performance in a second user study, and we report significant improvements on several measures. This work demonstrates the importance of understanding the human-teacher/robotlearner system as a whole in order to design algorithms that support how people want to teach while simultaneously improving the robot's learning...
Andrea Lockerd Thomaz, Cynthia Breazeal
Added 30 Oct 2010
Updated 30 Oct 2010
Type Conference
Year 2006
Where AAAI
Authors Andrea Lockerd Thomaz, Cynthia Breazeal
Comments (0)
books