Multi-information Ensemble Diversity

Abstract. Understanding ensemble diversity is one of the most important fundamental issues in ensemble learning. Inspired by a recent work trying to explain ensemble diversity from the information theoretic perspective, in this paper we study the ensemble diversity from the view of multi-information. We show that from this view, the ensemble diversity can be decomposed over the component classifiers constituting the ensemble. Based on this formulation, an approximation is given for estimating the diversity in practice. Experimental results show that our formulation and approximation are promising.

• Type: Conference
• Year: 2010
• Where: MCS
• Authors: Zhi-Hua Zhou, Nan Li
• Keywords: Ensemble Diversity, Ensemble Learning, MCS 2010, Pattern Recognition, Understanding Ensemble Diversity