Multi-class AdaBoost

作者：Trevor Hastie, Saharon Rosset, Ji Zhu, Hui Zou · 发表于：Statistics and Its Interface · 年份：2009 · DOI：10.4310/sii.2009.v2.n3.a8 · 被引用次数：1913 · 研究领域：Imbalanced Data Classification Techniques、Machine Learning and Algorithms、Machine Learning and Data Classification

Boosting has been a very successful technique for solving the two-class classification problem.In going from two-class to multi-class classification, most algorithms have been restricted to reducing the multi-class classification problem to multiple two-class problems.In this paper, we develop a new algorithm that directly extends the AdaBoost algorithm to the multi-class case without reducing it to multiple two-class problems.We show that the proposed multi-class AdaBoost algorithm is equivalent to a forward stagewise additive modeling algorithm that minimizes a novel exponential loss for multi-class classification.Furthermore, we show that the exponential loss is a member of a class of Fisher-consistent loss functions for multi-class classification.As shown in the paper, the new algorithm is extremely easy to implement and is highly competitive in terms of misclassification error rate.