Premium
Random subspace method with class separability weighting
Author(s) -
Mert Ahmet,
Kılıç Niyazi,
Bilgili Erdem
Publication year - 2016
Publication title -
expert systems
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.365
H-Index - 38
eISSN - 1468-0394
pISSN - 0266-4720
DOI - 10.1111/exsy.12149
Subject(s) - weighting , computer science , random subspace method , weighted voting , subspace topology , ensemble learning , pattern recognition (psychology) , artificial intelligence , class (philosophy) , randomness , voting , curse of dimensionality , machine learning , mathematics , algorithm , data mining , statistics , medicine , politics , political science , law , radiology
The random subspace method (RSM) is one of the ensemble learning algorithms widely used in pattern classification applications. RSM has the advantages of small error rate and improved noise insensitivity due to ensemble construction of the base‐learners. However, randomness may cause a reduction of the final ensemble decision performance because of contributions of classifiers trained by subsets with low class separability. In this study, we present a new and improved version of the RSM by introducing a weighting factor into the combination phase. One of the class separability criteria, J3, is used as a weighting factor to improve the classification performance and eliminate the drawbacks of the standard RSM algorithm. The randomly selected subsets are quantified by computing their J3 measure to determine voting weights in the model combination phase, assigning lower voting weight to classifiers trained by subsets with poor class separability. Two models are presented including J3‐weighted RSM and optimized J3 weighted RSM. In J3 weighted RSM, computed weighting values are directly multiplied by class assignment posteriors, whereas in optimized J3 weighted RSM, computed weighting values are optimized by a pattern search algorithm before multiplying by posteriors. Both models are shown to provide better error rates at lower subset dimensionality.