Estimating the error at given test input points for linear regression

In model selection procedures in supervised learning, a model is usually chosen so that the expected test error over all possible test input points is minimized. On the other hand, when the test input points (without output values) are available in advance, it is more effetive to choose a model so that the test error only at the test input points at hand is minimized. In this paper, we follow this idea and derive an estimator of the test error at the given test input points for linear regression. Our estimator is proved to be an unbiased estimator of the test error at the given test input points under certain conditions. Through the simulations with artificial and standard benchmark data sets, we show that the proposed method is successfully applied in test error estimation and is compared favorably to the standard cross-validation and an empirical Bayesian method in ridge parameter selection. KEY WORDS Machine Learning, Supervised Learning, Test Error, Expected Test Error, Model Sele...

• Type: Conference
• Year: 2004
• Where: NCI
• Authors: Masashi Sugiyama
• Keywords: Expected Test Error, NCI 2004, Neural Networks, Test Error, Test Input Points