Annotations for Opinion Mining Evaluation in the Industrial Context of the DOXA project

After presenting opinion and sentiment analysis state of the art and the DOXA project, we review the few evaluation campaigns that have dealt in the past with opinion mining. Then we present the two level opinion and sentiment model that we will use for evaluation in the DOXA project and the annotation interface we use for hand annotating a reference corpus. We then present the corpus which will be used on DOXA and report on the hand-annotation task on a corpus of comments on video games and the solution adopted to obtain a sufficient level of inter-annotator agreement.

• Type: Conference
• Year: 2010
• Where: LREC
• Authors: Patrick Paroubek, Alexander Pak, Djamel Mostefa
• Keywords: DOXA Project, Education, LREC 2010, Opinion Mining, Sentiment Analysis State