Premium
Generating ensembles of heterogeneous classifiers using Stacked Generalization
Author(s) -
Sesmero M. Paz,
Ledezma Agapito I.,
Sanchis Araceli
Publication year - 2015
Publication title -
wiley interdisciplinary reviews: data mining and knowledge discovery
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.506
H-Index - 47
eISSN - 1942-4795
pISSN - 1942-4787
DOI - 10.1002/widm.1143
Subject(s) - machine learning , artificial intelligence , computer science , boosting (machine learning) , stacking , classifier (uml) , ensemble learning , cascading classifiers , random subspace method , generalization , homogeneous , mathematics , mathematical analysis , physics , nuclear magnetic resonance , combinatorics
Over the last two decades, the machine learning and related communities have conducted numerous studies to improve the performance of a single classifier by combining several classifiers generated from one or more learning algorithms. Bagging and Boosting are the most representative examples of algorithms for generating homogeneous ensembles of classifiers. However, Stacking has become a commonly used technique for generating ensembles of heterogeneous classifiers since Wolpert presented his study entitled Stacked Generalization in 1992. Studies that have addressed the Stacking issue demonstrated that when selecting base learning algorithms for generating classifiers that are members of the ensemble, their learning parameters and the learning algorithm for generating the meta‐classifier were critical issues. Most studies on this topic manually select the appropriate combination of base learning algorithms and their learning parameters. However, some other methods use automatic methods to determine good Stacking configurations instead of starting from these strong initial assumptions. In this paper, we describe Stacking and its variants and present several examples of application domains. WIREs Data Mining Knowl Discov 2015, 5:21–34. doi: 10.1002/widm.1143 This article is categorized under: Technologies > Classification