Open AccessSentiment analysis of Indonesian hotel reviews: from classical machine learning to deep learning
Author(s) -
Retno Kusumaningrum,
Iffa Zainan Nisa,
Rizka Putri Nawangsari,
Adi Wibowo
Publication year - 2021
Publication title -
ijain (international journal of advances in intelligent informatics)
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.183
H-Index - 9
eISSN - 2548-3161
pISSN - 2442-6571
DOI - 10.26555/ijain.v7i3.737
Subject(s) - artificial intelligence , computer science , machine learning , word2vec , softmax function , deep learning , sentiment analysis , support vector machine , naive bayes classifier , convolutional neural network , hyperparameter , embedding
Currently, there are a large number of hotel reviews on the Internet that need to be evaluated to turn the data into practicable information. Deep learning has excellent capabilities for recognizing this type of data. With the advances in deep learning paradigms, many algorithms have been developed that can be used in sentiment analysis tasks. In this study, we aim to compare the performance of classical machine learning algorithms—logistic regression (LR), naïve Bayes (NB), and support vector machine (SVM) using the Word2Vec model in conjunction with deep learning algorithms such as a convolutional neural network (CNN) to classify hotel reviews on the Traveloka website into positive or negative classes. Both learning methods apply hyperparameter tuning to determine the parameters that produce the best model. Furthermore, the Word2Vec model parameters use the skip-gram model, hierarchical softmax evaluation, and the value of 100 vector dimensions. The highest average accuracy obtained was 98.08% by using the CNN with a dropout of 0.2, Tanh as convolution activation, softmax as output activation, and Adam as the optimizer. The findings from the study demonstrate that the integration of the Word2Vec model and the CNN model obtains significantly better accuracy than other classical machine learning methods.