Visual attention in spoken human-robot interaction

13 years 11 months ago

Download www.coli.uni-saarland.de

Psycholinguistic studies of situated language processing have revealed that gaze in the visual environment is tightly coupled with both spoken language comprehension and production. It has also been established that interlocutors monitor the gaze of their partners, a phenomenon called "joint attention", as a further means for facilitating mutual understanding. We hypothesise that humanrobot interaction will beneﬁt when the robot’s language-related gaze behaviour is similar to that of people, potentially providing the user with valuable non-verbal information concerning the robot’s intended message or the robot’s successful understanding. We report ﬁndings from two eye-tracking experiments demonstrating (1) that human gaze is modulated by both the robot speech and gaze, and (2) that human comprehension of robot speech is improved when the robot’s real-time gaze behaviour is similar to that of humans. Categories and Subject Descriptors I.2.9 [Artiﬁcial Intelligen...

Maria Staudte, Matthew W. Crocker

Real-time Traffic