Sciweavers

26 search results - page 1 / 6
» On Over-fitting in Model Selection and Subsequent Selection ...
Sort
View
JMLR
2010
118views more  JMLR 2010»
12 years 11 months ago
On Over-fitting in Model Selection and Subsequent Selection Bias in Performance Evaluation
Model selection strategies for machine learning algorithms typically involve the numerical optimisation of an appropriate model selection criterion, often based on an estimator of...
Gavin C. Cawley, Nicola L. C. Talbot
BMCBI
2006
110views more  BMCBI 2006»
13 years 4 months ago
Bias in error estimation when using cross-validation for model selection
Background: Cross-validation (CV) is an effective method for estimating the prediction error of a classifier. Some recent articles have proposed methods for optimizing classifiers...
Sudhir Varma, Richard Simon
SIGIR
2012
ACM
11 years 7 months ago
An uncertainty-aware query selection model for evaluation of IR systems
We propose a mathematical framework for query selection as a mechanism for reducing the cost of constructing information retrieval test collections. In particular, our mathematica...
Mehdi Hosseini, Ingemar J. Cox, Natasa Milic-Frayl...
CSDA
2006
102views more  CSDA 2006»
13 years 4 months ago
An improved Akaike information criterion for state-space model selection
Following the work of Hurvich, Shumway, and Tsai (1990), we propose an "improved" variant of the Akaike information criterion, AICi, for state-space model selection. The...
Thomas Bengtsson, Joseph E. Cavanaugh
CLUSTER
2004
IEEE
13 years 4 months ago
Performance Evaluation of Shared Mesh Protection in WDM Networks
The efficient use of network capacity in shared restoration schemes strongly depends upon the path selection procedure. In this paper we propose and evaluate path selection algorit...
Chadi Assi, Ahmad Khalil, Nasir Ghani, Abdallah Sh...