1900 search results - page 1 / 380 » Crowdsourcing for relevance evaluation |
SIGIR
2008
ACM
13 years 4 months ago
2008
ACM
Relevance evaluation is an essential part of the development and maintenance of information retrieval systems. Yet traditional evaluation approaches have several limitations; in p...
CIKM
2011
Springer
12 years 4 months ago
2011
Springer
Crowdsourcing platforms offer unprecedented opportunities for creating evaluation benchmarks, but suffer from varied output quality from crowd workers who possess different levels...
SIGIR
2012
ACM
11 years 7 months ago
2012
ACM
In crowdsourced relevance judging, each crowd worker typically judges only a small number of examples, yielding a sparse and imbalanced set of judgments in which relatively few wo...
BPM
2011
Springer
12 years 4 months ago
2011
Springer
Abstract. Crowdsourcing has emerged as an important paradigm in human problem-solving techniques on the Web. One application of crowdsourcing is to outsource certain tasks to the c...
SIGIR
2011
ACM
12 years 7 months ago
2011
ACM
We study how to best use crowdsourced relevance judgments learning to rank [1, 7]. We integrate two lines of prior work: unreliable crowd-based binary annotation for binary classi...