Sciweavers

EMMCVPR
2011
Springer
12 years 3 months ago
Optimization of Robust Loss Functions for Weakly-Labeled Image Taxonomies: An ImageNet Case Study
The recently proposed ImageNet dataset consists of several million images, each annotated with a single object category. However, these annotations may be imperfect, in the sense t...
Julian John McAuley, Arnau Ramisa, Tibério ...
SIGIR
2008
ACM
13 years 3 months ago
Novelty and diversity in information retrieval evaluation
Evaluation measures act as objective functions to be optimized by information retrieval systems. Such objective functions must accurately reflect user requirements, particularly w...
Charles L. A. Clarke, Maheedhar Kolla, Gordon V. C...
SIGIR
2008
ACM
13 years 3 months ago
Directly optimizing evaluation measures in learning to rank
One of the central issues in learning to rank for information retrieval is to develop algorithms that construct ranking models by directly optimizing evaluation measures used in i...
Jun Xu, Tie-Yan Liu, Min Lu, Hang Li, Wei-Ying Ma
ACL
2006
13 years 5 months ago
Training Conditional Random Fields with Multivariate Evaluation Measures
This paper proposes a framework for training Conditional Random Fields (CRFs) to optimize multivariate evaluation measures, including non-linear measures such as F-score. Our prop...
Jun Suzuki, Erik McDermott, Hideki Isozaki
TREC
2008
13 years 5 months ago
Where to Stop Reading a Ranked List?
: We document our participation in the TREC 2008 Legal Track. This year we focused solely on selecting rank cut-offs for optimizing the given evaluation measure per topic.
Avi Arampatzis, Jaap Kamps
AUSDM
2008
Springer
246views Data Mining» more  AUSDM 2008»
13 years 5 months ago
A New Evaluation Measure for Imbalanced Datasets
The area of imbalanced datasets is still relatively new, and it is known that the use of overall accuracy is not an appropriate evaluation measure for imbalanced datasets, because...
Cheng G. Weng, Josiah Poon