Oracle Coached Decision Trees and Lists

11 years 10 months ago
Oracle Coached Decision Trees and Lists
This paper introduces a novel method for obtaining increased predictive performance from transparent models in situations where production input vectors are available when building the model. First, labeled training data is used to build a powerful opaque model, called an oracle. Second, the oracle is applied to production instances, generating predicted target values, which are used as labels. Finally, these newly labeled instances are utilized, in different combinations with normal training data, when inducing a transparent model. Experimental results, on 26 UCI data sets, show that the use of oracle coaches significantly improves predictive performance, compared to standard model induction. Most importantly, both accuracy and AUC results are robust over all combinations of opaque and transparent models evaluated. This study thus implies that the straightforward procedure of using a coaching oracle, which can be used with arbitrary classifiers, yields significantly better predictive ...
Ulf Johansson, Cecilia Sönströd, Tuve L&
Added 25 Oct 2010
Updated 25 Oct 2010
Type Conference
Year 2010
Where IDA
Authors Ulf Johansson, Cecilia Sönströd, Tuve Löfström
Comments (0)