Scientific Data of an Evaluation Campaign: Do We Properly Deal with Them?

Abstract. This paper examines the current way of keeping the data produced during the evaluation campaigns and highlights some shortenings of it. As a consequence, we propose a new approach for improving the management evaluation campaigns' data. In this approach, the data are considered as scientific data to be cured and enriched in order to give full support to longitudinal statistical studies and long-term preservation. Categories and Subject Descriptors H.3 [Information Storage and Retrieval]: H.3.3 Information Search and Retrieval; H.3.4 [Systems and Software]: Performance evaluation. General Terms Experimentation, Performance, Measurement, Algorithms. Additional Keywords and Phrases Multilingual Information Access, Cross-Language Information Retrieval, Scientific Data, Data Curation, In-depth evaluation studies.

• Type: Conference
• Year: 2006
• Where: CLEF
• Authors: Maristella Agosti, Giorgio Maria Di Nunzio, Nicola Ferro
• Keywords: CLEF 2006, Evaluation Campaigns, Information Management, Management Evaluation Campaigns, Scientific Data