Multi-information Ensemble Diversity

10 years 10 months ago
Multi-information Ensemble Diversity
Abstract. Understanding ensemble diversity is one of the most important fundamental issues in ensemble learning. Inspired by a recent work trying to explain ensemble diversity from the information theoretic perspective, in this paper we study the ensemble diversity from the view of multi-information. We show that from this view, the ensemble diversity can be decomposed over the component classifiers constituting the ensemble. Based on this formulation, an approximation is given for estimating the diversity in practice. Experimental results show that our formulation and approximation are promising.
Zhi-Hua Zhou, Nan Li
Added 18 May 2010
Updated 18 May 2010
Type Conference
Year 2010
Where MCS
Authors Zhi-Hua Zhou, Nan Li
Comments (0)