Open AccessAnalisis Perbandingan Algoritma Klasifikasi MLP dan CNN pada Dataset American Sign Language
Author(s) -
Mohammad Farid Naufal,
Sesilia Shania,
Jessica Millenia,
Stefan Axel,
Juan Timothy Soebroto,
P Rizka Febrina,
Mirella Mercifia
Publication year - 2021
Publication title -
jurnal resti (rekayasa sistem dan teknologi informasi)
Language(s) - English
Resource type - Journals
ISSN - 2580-0760
DOI - 10.29207/resti.v5i3.3009
Subject(s) - sign language , computer science , gesture , speech recognition , sign (mathematics) , artificial intelligence , convolutional neural network , preprocessor , natural language processing , american sign language , pattern recognition (psychology) , linguistics , mathematics , mathematical analysis , philosophy
People who have hearing loss (deafness) or speech impairment (hearing impairment) usually use sign language to communicate. One of the most basic and flexible sign languages is the Alphabet Sign Language to spell out the words you want to pronounce. Sign language uses hand, finger, and face movements to speak the user's thoughts. However, for alphabetical sign language, facial expressions are not used but only gestures or symbols formed using fingers and hands. In fact, there are still many people who don't understand the meaning of sign language. The use of image classification can help people more easily learn and translate sign language. Image classification accuracy is the main problem in this case. This research conducted a comparison of image classification algorithms, namely Convolutional Neural Network (CNN) and Multilayer Perceptron (MLP) to recognize American Sign Language (ASL) except the letters "J" and "Z" because movement is required for both. This is done to see the effect of the convolution and pooling stages on CNN on the resulting accuracy value and F1 Score in the ASL dataset. Based on the comparison, the use of CNN which begins with Gaussian Low Pass Filtering preprocessing gets the best accuracy of 96.93% and F1 Score 96.97%