Sciweavers

Share
ICIA
2007

Eye Gaze for Attention Prediction in Multimodal Human-Machine Conversation

10 years 5 months ago
Eye Gaze for Attention Prediction in Multimodal Human-Machine Conversation
In a conversational system, determining a user’s focus of attention is crucial to the success of the system. Motivated by previous psycholinguistic findings, we are currently examining how eye gaze contributes to automated identification of user attention during humanmachine conversation. As part of this effort, we investigate the contributing roles of various features that are extracted from eye gaze and the visual interface. More precisely, we conduct a data-driven evaluation of these features and propose a novel evaluation metric for performing such an investigation. The empirical results indicate that gaze fixation intensity serves an integral role in attention prediction. Fixations to objects are fairly evenly distributed between the start of a reference and 1500 milliseconds prior. When combined with some visual features (e.g., the amount of visual occlusion of an object), fixation intensity can become even more reliable in predicting user attention. This paper describes t...
Zahar Prasov, Joyce Yue Chai, Hogyeong Jeong
Added 02 Oct 2010
Updated 02 Oct 2010
Type Conference
Year 2007
Where ICIA
Authors Zahar Prasov, Joyce Yue Chai, Hogyeong Jeong
Comments (0)
books