Sciweavers

CLEF
2006
Springer

Scientific Data of an Evaluation Campaign: Do We Properly Deal with Them?

13 years 9 months ago
Scientific Data of an Evaluation Campaign: Do We Properly Deal with Them?
Abstract. This paper examines the current way of keeping the data produced during the evaluation campaigns and highlights some shortenings of it. As a consequence, we propose a new approach for improving the management evaluation campaigns' data. In this approach, the data are considered as scientific data to be cured and enriched in order to give full support to longitudinal statistical studies and long-term preservation. Categories and Subject Descriptors H.3 [Information Storage and Retrieval]: H.3.3 Information Search and Retrieval; H.3.4 [Systems and Software]: Performance evaluation. General Terms Experimentation, Performance, Measurement, Algorithms. Additional Keywords and Phrases Multilingual Information Access, Cross-Language Information Retrieval, Scientific Data, Data Curation, In-depth evaluation studies.
Maristella Agosti, Giorgio Maria Di Nunzio, Nicola
Added 20 Aug 2010
Updated 20 Aug 2010
Type Conference
Year 2006
Where CLEF
Authors Maristella Agosti, Giorgio Maria Di Nunzio, Nicola Ferro
Comments (0)