Sciweavers

Share
ECML
2007
Springer

Seeing the Forest Through the Trees: Learning a Comprehensible Model from an Ensemble

9 years 5 months ago
Seeing the Forest Through the Trees: Learning a Comprehensible Model from an Ensemble
Abstract. Ensemble methods are popular learning methods that usually increase the predictive accuracy of a classifier though at the cost of interpretability and insight in the decision process. In this paper we aim to overcome this issue of comprehensibility by learning a single decision tree that approximates an ensemble of decision trees. The new model is obtained by exploiting the class distributions predicted by the ensemble. These are employed to compute heuristics for deciding which tests are to be used in the new tree. As such we acquire a model that is able to give insight in the decision process, while being more accurate than the single model directly learned on the data. The proposed method is experimentally evaluated on a large number of UCI data sets, and compared to an existing approach that makes use of artificially generated data. Key words: ensembles, decision trees, comprehensibility
Anneleen Van Assche, Hendrik Blockeel
Added 14 Aug 2010
Updated 14 Aug 2010
Type Conference
Year 2007
Where ECML
Authors Anneleen Van Assche, Hendrik Blockeel
Comments (0)
books