Informed Perspectives on Human Annotation Using Neural Signals

In this work we explore how neurophysiological correlates related to attention and perception can be used to better understand the image-annotation task. We explore the nature of the highly variable labelling data often seen across annotators. Our results indicate potential issues with regard to ‘how well’ a person manually annotates images and variability across annotators. We propose such issues arise in part as a result of subjectively interpretable instructions that may fail to elicit similar labelling behaviours and decision thresholds across participants. We find instances where an individual’s annotations di↵er from a group consensus, even though their EEG (Electroencephalography) signals indicate in fact they were likely in consensus with the group. We o↵er a new perspective on how EEG can be incorporated in an annotation task to reveal information not readily captured using manual annotations alone. As crowd-sourcing resources become more readily available for annot...

• Type: Journal
• Year: 2016
• Where: MMM
• Authors: Graham F. Healy, Cathal Gurrin, Alan F. Smeaton
• Keywords: MMM 2016, Multimedia