Many current effectiveness measures incorporate simplifying assumptions about user behavior. These assumptions prevent the measures from reflecting aspects of the search process...
Evaluation in Information Retrieval (IR) has long focused on effectiveness and efficiency. However, new and emerging access tasks now demand alternative evaluation measures which ...
The effects of out-of-vocabulary (OOV) items in spoken document retrieval (SDR) are investigated. Several sets of transcriptions were created for the TREC-8 SDR task using a speec...
Philip C. Woodland, Sue E. Johnson, P. Jourlin, Ka...
Cross language information retrieval is a field of study that has received significant research attention, resulting in systems that despite the errors of automatic translation (f...
Mark Sanderson, Paul Clough, Catherine Paterson, W...
The dominant method for evaluating search engines is the Cranfield paradigm, but the existing metrics do not consider some modern search engines features, such as document snippets...