Semi-Supervised Model Selection Based on Cross-Validation

14 years 1 months ago
Semi-Supervised Model Selection Based on Cross-Validation
We propose a new semi-supervised model selection method that is derived by applying the structural risk minimization principle to a recent semi-supervised generalization error bound. This bound that we build on is based on the cross-validation estimate underlying the popular cross-validation model selection heuristic. Thus, the proposed semi-supervised method is closely connected to cross-validation which makes studying these methods side by side very natural. We evaluate the performance of the proposed method and the cross-validation heuristic empirically on the task of selecting the parameters of support vector machines. The experiments indicate that the models selected by the two methods have roughly the same accuracy. However, whereas the cross-validation heuristic only proposes which classifier to choose, the semi-supervised method provides also a reliable and reasonably tight generalization error guarantee for the chosen classifier. Thus, when unlabeled data is available, the ...
Matti Kaariainen
Added 11 Jun 2010
Updated 11 Jun 2010
Type Conference
Year 2006
Authors Matti Kaariainen
Comments (0)