229 search results - page 2 / 46 » Evaluation measures for preference judgments |
LREC
2008
13 years 7 months ago
2008
Evaluation of Machine Translation (MT) technology is often tied to the requirement for tedious manual judgments of translation quality. While automated MT metrology continues to b...
SIGIR
2006
ACM
13 years 11 months ago
2006
ACM
We consider the problem of large-scale retrieval evaluation, and we propose a statistical method for evaluating retrieval systems using incomplete judgments. Unlike existing techn...
CIKM
2006
Springer
13 years 9 months ago
2006
Springer
We consider the problem of evaluating retrieval systems using incomplete judgment information. Buckley and Voorhees recently demonstrated that retrieval systems can be efficiently...
LREC
2008
13 years 7 months ago
2008
Polarizing discussions about political and social issues are common in mass media. Annotations on the degree to which a sentence expresses an ideological perspective can be valuab...
SIGIR
2008
ACM
13 years 5 months ago
2008
ACM
Information retrieval evaluation has typically been performed over several dozen queries, each judged to near-completeness. There has been a great deal of recent work on evaluatio...