Sciweavers

CIKM
2009
Springer

Measuring system performance and topic discernment using generalized adaptive-weight mean

13 years 1 months ago
Measuring system performance and topic discernment using generalized adaptive-weight mean
Standard approaches to evaluating and comparing information retrieval systems compute simple averages of performance statistics across individual topics to measure the overall system performance. However, topics vary in their ability to differentiate among systems based on their retrieval performance. At the same time, systems that perform well on discriminative queries demonstrate notable qualities that should be reflected in the systems' evaluation and ranking. This motivated research on alternative performance measures that are sensitive to the discriminative value of topics and the performance consistency of systems. In this paper we provide a mathematical formulation of a performance measure that postulates the dependence between the system and topic characteristics. We propose the Generalized Adaptive-Weight Mean (GAWM) measure and show how it can be computed as a fixed point of a function for which the Brouwer Fixed Point Theorem applies. This guarantees the existence of a...
Chung Tong Lee, Vishwa Vinay, Eduarda Mendes Rodri
Added 16 Feb 2011
Updated 16 Feb 2011
Type Journal
Year 2009
Where CIKM
Authors Chung Tong Lee, Vishwa Vinay, Eduarda Mendes Rodrigues, Gabriella Kazai, Natasa Milic-Frayling, Aleksandar Ignjatovic
Comments (0)