Premium
Benchmarking in classification and regression
Author(s) -
Hoffmann Frank,
Bertram Torsten,
Mikut Ralf,
Reischl Markus,
Nelles Oliver
Publication year - 2019
Publication title -
wiley interdisciplinary reviews: data mining and knowledge discovery
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.506
H-Index - 47
eISSN - 1942-4795
pISSN - 1942-4787
DOI - 10.1002/widm.1318
Subject(s) - benchmarking , computer science , machine learning , artificial intelligence , key (lock) , best practice , data science , benchmark (surveying) , data mining , geography , computer security , management , geodesy , marketing , economics , business
The article presents an overview of the status quo in benchmarking in classification and nonlinear regression. It outlines guidelines for a comparative analysis in machine learning, benchmarking principles, accuracy estimation, and model validation. It provides references to established repositories and competitions and discusses the objectives and limitations of benchmarking. Benchmarking is key to progress in machine learning as it allows an unprejudiced comparison among alternative methods. This article presents guidelines and best practices for benchmarking in classification and regression. It reviews state‐of‐the‐art approaches in machine learning, establishes benchmarking principles and discusses performance metrics for a sound statistical comparative analysis. This article is categorized under: Technologies > Computational Intelligence Fundamental Concepts of Data and Knowledge > Key Design Issues in Data Mining Technologies > Machine Learning Technologies > Classification