Premium
A comprehensive empirical comparison of modern supervised classification and feature selection methods for text categorization
Author(s) -
Aphinyanaphongs Yindalon,
Fu Lawrence D.,
Li Zhiguo,
Peskin Eric R.,
Efstathiadis Efstratios,
Aliferis Constantin F.,
Statnikov Alexander
Publication year - 2014
Publication title -
journal of the association for information science and technology
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.903
H-Index - 145
eISSN - 2330-1643
pISSN - 2330-1635
DOI - 10.1002/asi.23110
Subject(s) - feature selection , categorization , computer science , selection (genetic algorithm) , benchmark (surveying) , artificial intelligence , text categorization , machine learning , feature (linguistics) , field (mathematics) , data mining , pattern recognition (psychology) , information retrieval , mathematics , linguistics , philosophy , geography , geodesy , pure mathematics
An important aspect to performing text categorization is selecting appropriate supervised classification and feature selection methods. A comprehensive benchmark is needed to inform best practices in this broad application field. Previous benchmarks have evaluated performance for a few supervised classification and feature selection methods and limited ways to optimize them. The present work updates prior benchmarks by increasing the number of classifiers and feature selection methods order of magnitude, including adding recently developed, state‐of‐the‐art methods. Specifically, this study used 229 text categorization data sets/tasks, and evaluated 28 classification methods (both well‐established and proprietary/commercial) and 19 feature selection methods according to 4 classification performance metrics. We report several key findings that will be helpful in establishing best methodological practices for text categorization.