(Department of Informatics, Universitas Diponegoro, Indonesia)(2) * Retno Kusumaningrum
(Department of Informatics, Universitas Diponegoro, Indonesia)(3) Adi Wibowo
(Department of Informatics, Universitas Diponegoro, Indonesia)*corresponding author
AbstractAdvances in information technology have given rise to online hotel reservation options. The user review feature is an important factor during the online booking of hotels. Generally, most online hotel booking service providers provide review and rating features for assessing hotels. However, not all service providers provide rating features or recap reviews for every aspect of the hotel services offered. Therefore, we propose a method to summarise reviews based on multiple aspects, including food, room, service, and location. This method uses long short-term memory (LSTM), together with hidden layers and automation of the optimal number of hidden neurons. The F1-measure value of 75.28% for the best model was based on the fact that (i) the size of the first hidden layer is 1,200 neurons with the tanh activation function, and (ii) the size of the second hidden layer is 600 neurons with the ReLU activation function. The proposed model outperforms the baseline model (also known as standard LSTM) by 10.16%. It is anticipated that the model developed through this study can be accessed by users of online hotel booking services to acquire a review recap on more specific aspects of services offered by hotels
KeywordsAspect-based sentiment analysis; Deep neural network; Long short-term memory; Hotel review; Indonesian language
|
DOIhttps://doi.org/10.26555/ijain.v8i3.691 |
Article metricsAbstract views : 1264 | PDF views : 289 |
Cite |
Full Text Download
|
References
[1] D. Ekawati and M. L. Khodra, “Aspect-based sentiment analysis for Indonesian restaurant reviews,†in Proc. of 2017 International Conference on Advanced Informatics, Concepts, Theory, and Applications (ICAICTA), 2017, pp. 1–6. doi: 10.1109/ICAICTA.2017.8090963.
[2] M. Pontiki, D. Galanis, J. Pavlopoulos, H. Papageorgiou, I. Androutsopoulos, and S. Manandhar, “SemEval-2014 Task 4: Aspect based sentiment analysis,†in Proceedings of the 8th International Workshop on Semantic Evaluation (SemEval 2014), 2014, pp. 27–35. doi: 10.3115/v1/S14-2004.
[3] J. Fernando, M. L. Khodra, and A. A. Septiandri, “Aspect and opinion terms extraction using double embeddings and attention mechanism for Indonesian hotel reviews,†2019. doi: 10.1109/ICAICTA.2019.8904124.
[4] A. A. Septiandri and A. P. Sutiono, “Aspect and Opinion Term Extraction for Aspect Based Sentiment Analysis of Hotel Reviews Using Transfer Learning,†2019. doi : 10.48550/arXiv.1909.11879.
[5] W. Wang, S. J. Pan, D. Dahlmeier, and X. Xiao, “Coupled multi-layer attentions for co-extraction of aspect and opinion terms,†in Proc. of the Thirty-First AAAI Conference on Artificial Intelligence, 2017, pp. 3316–3322. doi : 10.1609/aaai.v31i1.10974.
[6] H. Xu, B. Liu, L. Shu, and P. S. Yu, “Double embeddings and CNN-based sequence labeling for aspect extraction,†in Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), 2018, pp. 592–598. doi: 10.18653/v1/P18-2094.
[7] J. Devlin, M. W. Chang, K. Lee, and K. Toutanova, “BERT: Pre-training of deep bidirectional transformers for language understanding,†in Proc. Conf. North Am. Chapter Assoc. Comput. Linguist. Hum. Lang. Technol., 2019, pp. 4171–4186. doi : 10.48550/arXiv.1810.04805.
[8] C. Fiarni, H. Maharani, and R. Pratama, “Sentiment analysis system for Indonesia online retail shop review using hierarchy Naive Bayes technique,†2016. doi: 10.1109/ICoICT.2016.7571912.
[9] S. Gojali and M. L. Khodra, “Aspect Based Sentiment Analysis for Review Rating Prediction,†in 2016 International Conference On Advanced Informatics: Concepts, Theory And Application, 2016, pp. 1–6. doi: 10.1109/ICAICTA.2016.7803110.
[10] D. H. Sasmita, A. F. Wicaksono, S. Louvan, and M. Adriani, “Unsupervised aspect-based sentiment analysis on Indonesian restaurant reviews,†in Proceeding of 2017 International Conference on Asian Language Processing (IALP), 2017, pp. 383–386. doi: 10.1109/IALP.2017.8300623.
[11] A. Cahyadi and M. L. Khodra, “Aspect-based sentiment analysis using convolutional neural network and bidirectional long short-term memory,†in Proceeding of 2018 5th International Conference on Advanced Informatics: Concept Theory and Applications (ICAICTA), 2018, pp. 124–129. doi: 10.1109/ICAICTA.2018.8541300.
[12] Z. Fachrina and D. H. Widyantoro, “Aspect-sentiment classification in opinion mining using the combination of rule-based and machine learning,†2017. doi: 10.1109/ICODSE.2017.8285850.
[13] A. Ilmania, Abdurrahman, S. Cahyawijaya, and A. Purwarianti, “Aspect detection and sentiment classification using deep neural network for Indonesian aspect-based sentiment analysis,†in Proceeding of 2018 International Conference on Asian Language Processing, 2018, pp. 62–67. doi: 10.1109/IALP.2018.8629181.
[14] L. Qi and L. Chen, “A linear-chain CRF-based learning approach for web opinion mining,†in Proceeding of the International Conference on Web Information Systems Engineering, 2010, pp. 128–141. doi: 10.1007/978-3-642-17616-6_13.
[15] F. Tang, L. Fu, B. Yao, and W. Xu, “Aspect based fine-grained sentiment analysis for online reviews,†Inf. Sci. (Ny)., vol. 488, pp. 190–204, 2019, doi: 10.1016/j.ins.2019.02.064.
[16] M. Al-Smadi, O. Qawasmeh, M. Al-Ayyoub, Y. Jararweh, and B. Gupta, “Deep recurrent neural network vs. support vector machine for aspect-based sentiment analysis of Arabic hotels’ reviews,†J. Comput. Sci., vol. 27, pp. 386–393, 2018, doi: 10.1016/j.jocs.2017.11.006.
[17] N. Akhtar, N. Zubair, A. Kumar, and T. Ahmad, “Aspect based Sentiment Oriented Summarization of Hotel Reviews,†Procedia Comput. Sci., vol. 115, pp. 563–571, 2017, doi: 10.1016/j.procs.2017.09.115.
[18] O. Alqaryouti, N. Siyam, A. A. Monem, and K. Shaalan, “Aspect-based sentiment analysis using smart government review data,†Appl. Comput. Informatics, 2020, doi: 10.1016/j.aci.2019.11.003.
[19] N. Liu and B. Shen, “ReMemNN: A novel memory neural network for powerful interaction in aspect-based sentiment analysis,†Neurocomputing, vol. 395, pp. 66–67, 2020, doi: 10.1016/j.neucom.2020.02.018.
[20] N. Liu and B. Shen, “Aspect-based sentiment analysis with gated alternate neural network,†Knowledge-Based Syst., vol. 188, p. 105010, 2020, doi: 10.1016/j.knosys.2019.105010.
[21] D. Tang, B. Qin, and T. Liu, “Aspect level sentiment classification with deep memory network,†in Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, 2014, pp. 214–224. doi : 10.18653/v1/D16-1021
[22] R. P. Nawangsari, R. Kusumaningrum, and A. Wibowo, “Word2vec for Indonesian sentiment analysis towards hotel reviews: An evaluation study,†Procedia Comput. Sci., vol. 157, pp. 360–366, 2019, doi: 10.1016/j.procs.2019.08.178.
[23] E. Haddi, X. Liu, and Y. Shi, “The role of text pre-processing in sentiment analysis,†Procedia Comput. Sci., vol. 17, pp. 26–32, 2013, doi: 10.1016/j.procs.2013.05.005.
[24] A. Kulkarni and S. Mundhe, “A theoretical review on text mining: Tools, techniques, applications and future challenges,†Int. J. Innov. Res. Comput. Commun. Eng., vol. 4, no. 11, pp. 19225–19230, 2016, doi: 10.15680/IJIRCCE.2016. 0411037.
[25] S. Kannan and V. Gurusamy, “Preprocessing Techniques for text mining,†Int. J. Comput. Sci. Commun. Networks, vol. 5, no. 1, pp. 7–16, 2014. Available at : Google Scholar.
[26] T. Mikolov, G. Corrado, K. Chen, and J. Dean, “Efficient estimation of word representations in vector space,†in ICLR, 2013, pp. 1–12. doi : 10.48550/arXiv.1301.3781
[27] S. Hochreiter and J. Schmidhuber, “Long short-term memory,†Neural Comput., vol. 9, no. 8, pp. 1735–1780, 1997, doi: 10.1162/neco.1997.9.8.1735.
[28] Y. Wang, M. Huang, X. Zhu, and L. Zhao, “Attention-based LSTM for aspect-level sentiment classification,†in Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing (EMNLP), 2016, pp. 606–615. doi: 10.18653/v1/d16-1058.
[29] Y. Yang and X. Liu, “A re-examination of text categorization methods,†1999. doi : 10.1145/312624.312647
[30] I. Shafi, J. Ahmad, S. I. Shah, and F. M. Kashif, “Impact of varying neurons and hidden layers in neural network architecture for a time frequency application,†2006. doi: 10.1109/INMIC.2006.358160.
[31] C. E. Nwankpa, W. Ijomah, A. Gachagan, and S. Marshall, “Activation Functions: Comparison of trends in Practice and Research for Deep Learning,†in Proceeding of the 2nd International Conference on Computational Sciences and Technologies, 2020, pp. 124–133. doi :10.48550/arXiv.1811.03378.
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
___________________________________________________________
International Journal of Advances in Intelligent Informatics
ISSN 2442-6571 (print) | 2548-3161 (online)
Organized by UAD and ASCEE Computer Society
Published by Universitas Ahmad Dahlan
W: http://ijain.org
E: info@ijain.org (paper handling issues)
andri.pranolo.id@ieee.org (publication issues)
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0