260
Voted
SIGIR
2012
ACM
13 years 10 months ago
2012
ACM
In crowdsourced relevance judging, each crowd worker typically judges only a small number of examples, yielding a sparse and imbalanced set of judgments in which relatively few wo...
260
Voted
SIGIR
2011
ACM
14 years 10 months ago
2011
ACM
We study how to best use crowdsourced relevance judgments learning to rank [1, 7]. We integrate two lines of prior work: unreliable crowd-based binary annotation for binary classi...