Sciweavers

5489 search results - page 13 / 1098
» Evaluating evaluation measure stability
Sort
View
83
Voted
ACL
2006
15 years 1 months ago
Training Conditional Random Fields with Multivariate Evaluation Measures
This paper proposes a framework for training Conditional Random Fields (CRFs) to optimize multivariate evaluation measures, including non-linear measures such as F-score. Our prop...
Jun Suzuki, Erik McDermott, Hideki Isozaki
LREC
2008
128views Education» more  LREC 2008»
15 years 1 months ago
Automatic Evaluation Measures for Statistical Machine Translation System Optimization
Evaluation of machine translation (MT) output is a challenging task. In most cases, there is no single correct translation. In the extreme case, two translations of the same input...
Arne Mauser, Sasa Hasan, Hermann Ney
68
Voted
SIGIR
2008
ACM
14 years 11 months ago
Evaluation measures for preference judgments
There has been recent interest in collecting user or assessor preferences, rather than absolute judgments of relevance, for the evaluation or learning of ranking algorithms. Since...
Ben Carterette, Paul N. Bennett
MMS
2006
14 years 11 months ago
Evaluation and analysis of similarity measures for content-based visual information retrieval
The selection of appropriate proximity measures is one of the crucial success factors of content-based visual information retrieval. In this area of research, proximity measures ar...
Horst Eidenberger
CIKM
2008
Springer
15 years 1 months ago
Retrievability: an evaluation measure for higher order information access tasks
Evaluation in Information Retrieval (IR) has long focused on effectiveness and efficiency. However, new and emerging access tasks now demand alternative evaluation measures which ...
Leif Azzopardi, Vishwa Vinay