Sciweavers

Share
CLEF
2004
Springer

Overview of the CLEF 2004 Multilingual Question Answering Track

8 years 9 months ago
Overview of the CLEF 2004 Multilingual Question Answering Track
Following the pilot Question Answering Track at CLEF 2003, a new evaluation exercise for multilingual QA systems took place in 2004. This paper reports on the novelties introduced in the new campaign and on participants’ results. Almost all the cross-language combinations between nine source languages and seven target languages were exploited to set up more than fifty different tasks, both monolingual and bilingual. New types of questions (How- questions and definition questions) were given as input to the participating systems, while just one exact answer per question was allowed as output. The evaluation exercise has highlighted some difficulties in assessing definition questions and can be improved in the future, but the overall analysis of submissions shows encouraging results.
Bernardo Magnini, Alessandro Vallin, Christelle Ay
Added 01 Jul 2010
Updated 01 Jul 2010
Type Conference
Year 2004
Where CLEF
Authors Bernardo Magnini, Alessandro Vallin, Christelle Ayache, Gregor Erbach, Anselmo Peñas, Maarten de Rijke, Paulo Rocha, Kiril Ivanov Simov, Richard F. E. Sutcliffe
Comments (0)
books