229 search results - page 1 / 46 » Evaluation measures for preference judgments |
SIGIR
2008
ACM
13 years 4 months ago
2008
ACM
There has been recent interest in collecting user or assessor preferences, rather than absolute judgments of relevance, for the evaluation or learning of ranking algorithms. Since...
SIGIR
2012
ACM
11 years 7 months ago
2012
ACM
In this paper, we propose a novel top-k learning to rank framework, which involves labeling strategy, ranking model and evaluation measure. The motivation comes from the difficul...
ECIR
2008
Springer
13 years 6 months ago
2008
Springer
Abstract. Information retrieval systems have traditionally been evaluated over absolute judgments of relevance: each document is judged for relevance on its own, independent of oth...
EACL
2009
ACL Anthology
14 years 5 months ago
2009
ACL Anthology
We present the results of a large-scale, end-to-end human evaluation of various sentiment summarization models. The evaluation shows that users have a strong preference for summar...
TASLP
2011
12 years 11 months ago
2011
Abstract—A probabilistic kernel approach to pairwise preference learning based on Gaussian processes is applied to predict preference judgments for sound quality degradation mech...