Open AccessComparison of classical machine learning algorithms in the task of handwritten digits classification
Author(s) -
Oleksandr Voloshchenko,
Małgorzata Plechawska–Wójcik
Publication year - 2021
Publication title -
journal of computer sciences institute
Language(s) - English
Resource type - Journals
ISSN - 2544-0764
DOI - 10.35784/jcsi.2723
Subject(s) - mnist database , computer science , decision tree , support vector machine , task (project management) , artificial intelligence , machine learning , random forest , algorithm , digit recognition , logistic regression , statistical classification , pattern recognition (psychology) , deep learning , artificial neural network , engineering , systems engineering
The purpose of this paper is to compare classical machine learning algorithms for handwritten number classification. The following algorithms were chosen for comparison: Logistic Regression, SVM, Decision Tree, Random Forest and k-NN. MNIST handwritten digit database is used in the task of training and testing the above algorithms. The dataset consists of 70,000 images of numbers from 0 to 9. The algorithms are compared considering such criteria as the learning speed, prediction construction speed, host machine load, and classification accuracy. Each algorithm went through the training and testing phases 100 times, with the desired KPIs retained at each iteration. The results were averaged to reach reliable outcomes.