The Value of Agreement, a New Boosting Algorithm

We present a new generalization bound where the use of unlabeled examples results in a better ratio between training-set size and the resulting classifier’s quality and thus reduce the number of labeled examples necessary for achieving it. This is achieved by demanding from the algorithms generating the classifiers to agree on the unlabeled examples. The extent of this improvement depends on the diversity of the learners—a more diverse group of learners will result in a larger improvement whereas using two copies of a single algorithm gives no advantage at all. As a proof of concept, we apply the algorithm, named AgreementBoost, to a web classification problem where an up to 40% reduction in the number of labeled examples is obtained.

• Type: Conference
• Year: 2005
• Where: COLT
• Authors: Boaz Leskes
• Keywords: Better Ratio, COLT 2005, Training-set Size, Unlabeled Examples