Premium
Prediction confidence‐based dynamic selection and weighted integration
Author(s) -
Li LeiJun,
Li MeiZheng,
Mi JuSheng,
Xie Bin
Publication year - 2018
Publication title -
concurrency and computation: practice and experience
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.309
H-Index - 67
eISSN - 1532-0634
pISSN - 1532-0626
DOI - 10.1002/cpe.5055
Subject(s) - structural risk minimization , computer science , ensemble learning , machine learning , margin (machine learning) , artificial intelligence , selection (genetic algorithm) , key (lock) , sample (material) , generalization , minification , computation , base (topology) , data mining , pattern recognition (psychology) , mathematics , algorithm , support vector machine , mathematical analysis , chemistry , computer security , chromatography , programming language
Summary Ensemble learning is a successful learning paradigm and has gained considerable attention due to good generalization performance. Selection and integration of base learners are two key issues to construct an ensemble system. In this paper, a new kind framework of dynamic selection and weighted integration is proposed based on prediction confidence. In order to predict a sample, the base learners whose prediction confidences on the sample greater than or equal to a specified threshold are selected, and a final prediction is made based on the selected base learners with weighted integration. In weighted integration, the weight of a learner is computed based on its prediction confidence. Since the prediction confidences on different samples are different, the selected base learners as well as the weights are usually different for different samples. The computation of threshold is a key to the proposed framework. In classification ensemble, the threshold is computed via minimization of margin loss. In regression ensemble, the threshold is computed via minimization of prediction error. We analyze the rationality of the proposed framework in detail, and compare it with some other popular methods based on UCI classification tasks and short‐term wind speed prediction, respectively. Experimental results validate its effectiveness.