Sciweavers

Share
HRI
2006
ACM

Working with robots and objects: revisiting deictic reference for achieving spatial common ground

9 years 10 months ago
Working with robots and objects: revisiting deictic reference for achieving spatial common ground
Robust joint visual attention is necessary for achieving a common frame of reference between humans and robots interacting multimodally in order to work together on realworld spatial tasks involving objects. We make a comprehensive examination of one component of this process that is often otherwise implemented in an ad hoc fashion: the ability to correctly determine the object referent from deictic reference including pointing gestures and speech. We develop a modular spatial reasoning framework based around decomposition and resynthesis of speech and gesture into a language of pointing and object labeling that supports multimodal and unimodal access in both real-world and mixedreality workspaces, accounts for the need to discriminate and sequence identical and proximate objects, assists in overcoming inherent precision limitations in deictic gesture, and assists in the extraction of those gestures. We further discuss an implementation of the framework that has been deployed on two h...
Andrew G. Brooks, Cynthia Breazeal
Added 13 Jun 2010
Updated 13 Jun 2010
Type Conference
Year 2006
Where HRI
Authors Andrew G. Brooks, Cynthia Breazeal
Comments (0)
books