(Department of Informatics, Universitas Jenderal Achmad Yani, Indonesia)(2) Hamid Fadhilah
(Department of Informatics, Universitas Jenderal Achmad Yani, Indonesia)(3) Asep Najmurrokhman
(Department of Electrical Engineering, Universitas Jenderal Achmad Yani, Indonesia)(4) Arlisa Wulandari
(Department of Medicine, Universitas Jenderal Achmad Yani, Indonesia)(5) Faiza Renaldi
(Department of Informatics, Universitas Jenderal Achmad Yani, Indonesia)*corresponding author
AbstractBrain-Computer Interface (BCI) has an intermediate tool that is usually obtained from EEG signal information. This paper proposed the BCI to control a robot simulator based on three emotions for five seconds by extracting a wavelet function in advance with Recurrent Neural Networks (RNN). Emotion is amongst variables of the brain that can be used to move external devices. BCI's success depends on the ability to recognize one person’s emotions by extracting their EEG signals. One method to appropriately recognize EEG signals as a moving signal is wavelet transformation. Wavelet extracted EEG signal into theta, alpha, and beta wave, and consider them as the input of the RNN technique. Connectivity between sequences is accomplished with Long Short-Term Memory (LSTM). The study also compared frequency extraction methods using Fast Fourier Transform (FFT). The results showed that by extracting EEG signals using Wavelet transformations, we could achieve a confident accuracy of 100% for the training data and 70.54% of new data. While the same RNN configuration without pre-processing provided 39% accuracy, even adding FFT would only increase it to 52%. Furthermore, by using features of the frequency filter, we can increase its accuracy from 70.54% to 79.3%. These results showed the importance of selecting features because of RNNs concern to sequenced its inputs. The use of emotional variables is still relevant for instructions on BCI-based external devices, which provide an average computing time of merely 0.235 seconds.
KeywordsBrain-Computer Interface; Emotion recognition; Recurrent Neural Networks; robot simulator; Wavelet; LSTM
|
DOIhttps://doi.org/10.26555/ijain.v6i1.432 |
Article metricsAbstract views : 1969 | PDF views : 489 |
Cite |
Full Text Download
|
References
[1] E. C. Djamal, M. Y. Abdullah, and F. Renaldi, “Brain Computer Interface Game Controlling Using Fast Fourier Transform and Learning Vector Quantization,” J. Telecommun. Electron. Comput. Eng., vol. 9, no. 2–5, pp. 71–74, 2017, available at: Google Scholar.
[2] M. Van Vliet, A. Robben, N. Chumerin, N. V. Manyakov, A. Combaz, and M. M. Van Hulle, “Designing a brain-computer interface controlled video-game using consumer grade EEG hardware,” 2012 ISSNIP Biosignals Biorobotics Conf. Biosignals Robot. Better Safer Living, BRC 2012, 2012, doi: 10.1109/BRC.2012.6222186.
[3] D. Ming, Y. Zhu, H. Qi, B. Wan, Y. Hu, and K. D. K. Luk, “Study on EEG-based mouse system by using brain-computer interface,” in 2009 IEEE International Conference on Virtual Environments, Human-Computer Interfaces, and Measurements Systems, VECIMS 2009 - Proceedings, 2009, no. 60501005, pp. 236–239, doi: 10.1109/VECIMS.2009.5068900.
[4] S. Ramesh, M. G. Krishna, and M. Nakirekanti, “Brain Computer Interface System for Mind Controlled Robot using Bluetooth,” Int. J. Comput. Appl., vol. 104, no. 15, pp. 20–23, 2014, available at: Google Scholar.
[5] F. Cincotti et al., “Non-Invasive Brain-Computer Interface System: Towards its Application as Assistive Technology,” Brain Res. Bull., vol. 75, no. 6, pp. 796–803, 2008, doi: 10.1016/j.brainresbull.2008.01.007.
[6] M. Bamdad, H. Zarshenas, and M. A. Auais, “Application of BCI systems in neurorehabilitation: A scoping review,” Disabil. Rehabil. Assist. Technol., vol. 10, no. 5, pp. 355–364, 2015, doi: 10.3109/17483107.2014.961569.
[7] J. J. Daly and J. E. Huggins, “Brain-Computer Interface: Current and Emerging Rehabilitation Applications,” Arch. Phys. Med. Rehabil., vol. 96, no. 3, pp. S1–S7, 2015, doi: 10.1016/j.apmr.2015.01.007.
[8] Y. Li, J. Pan, F. Wang, and Z. Yu, “A hybrid BCI System Combining P300 and SSVEP and Its Application to Wheelchair Control,” IEEE Trans. Biomed. Eng., vol. 60, no. 11, pp. 3156–3166, 2013, doi: 10.1109/TBME.2013.2270283.
[9] F. Velasco-Álvarez, R. Ron-Angevin, L. da Silva-Sauer, and S. Sancha-Ros, “Audio-Cued Motor Imagery-Based Brain-Computer Interface: Navigation Through Virtual and Real Environments,” Neurocomputing, vol. 121, pp. 89–98, 2013, doi: 10.1016/j.neucom.2012.11.038.
[10] J. Atkinson and D. Campos, “Improving BCI-based emotion recognition by combining EEG feature selection and kernel classifiers R,” Expert Syst. Appl., vol. 47, pp. 35–41, 2016, doi: 10.1016/j.eswa.2015.10.049.
[11] S. Taran and V. Bajaj, “Computer Methods and Programs in Biomedicine Emotion Recognition from Single-channel EEG Signals Using a Two-stage Correlation and Instantaneous Frequency-based Filtering Method,” Comput. Methods Programs Biomed., vol. 173, pp. 157–165, 2019, doi: 10.1016/j.cmpb.2019.03.015.
[12] B. Kaur, D. Singh, and P. P. Roy, “EEG Based Emotion Classification Mechanism in BCI,” in Procedia Computer Science: International Conference on Computational Intelligence and Data Science (ICCIDS 2018, 2018, vol. 132, pp. 752–758, doi: 10.1016/j.procs.2018.05.087.
[13] J. Prescott, “Some Considerations in the Measurement of Emotions in Sensory and Consumer Research,” Food Qual. Prefer., vol. 62, no. December 2016, pp. 360–368, 2017, doi: 10.1016/j.foodqual.2017.04.005.
[14] C. Liu, S. Xie, X. Xie, X. Duan, W. Wang, and K. Obermayer, “Design of a Video Feedback SSVEP-BCI System for Car Control based on Improved MUSIC Method,” in 2018 6th International Conference on Brain-Computer Interface (BCI), 2018, pp. 2–5, doi: 10.1109/IWW-BCI.2018.8311499.
[15] R. Krepki, B. Blankertz, G. Curio, and K. R. Müller, “The Berlin Brain-Computer Interface (BBCI) - Towards a new communication channel for online control in gaming applications,” Multimed. Tools Appl., vol. 33, no. 1, pp. 73–90, 2007, doi: 10.1007/s11042-006-0094-3.
[16] Z. H. Murat, N. Buniyamin, N. Kimpol, and A. Mohamed, “Analysing the effect of Motion Technology on EEG and its effect on students’ concentration and focus,” in 2015 IEEE 7th International Conference on Engineering Education, ICEED 2015, 2016, pp. 54–58, doi: 10.1109/ICEED.2015.7451492.
[17] J. R. Wolpaw, N. Birbaumer, D. J. McFarland, G. Pfurtscheller, and T. M. Vaughan, “Brain Computer Interfaces for communication and control,” Front. Neurosci., vol. 4, no. 113, pp. 767–791, 2002, doi: 10.3389/conf.fnins.2010.05.00007.
[18] E. C. Djamal, Suprijanto, and S. J. Setiadi, “Classification of EEG-Based Hand Grasping Imagination Using Autoregressive and Neural Networks,” J. Teknol., vol. 78, no. 6–6, pp. 105–110, 2016, doi: 10.11113/jt.v78.9035.
[19] D. Coyle, J. Garcia, A. R. Satti, and T. M. McGinnity, “EEG-based continuous control of a game using a 3 channel motor imagery BCI: BCI game,” IEEE SSCI 2011 - Symp. Ser. Comput. Intell. - CCMB 2011 2011 IEEE Symp. Comput. Intell. Cogn. Algorithms, Mind, Brain, pp. 88–94, 2011, doi: 10.1109/CCMB.2011.5952128.
[20] E. C. Djamal and P. Lodaya, “EEG Based Emotion Monitoring Using Wavelet and Learning Vector Quantization,” in 2017 4th International Conference on Electrical Engineering, Computer Science and Informatics (EECSI 2017), 2017, pp. 19–21, doi: 10.1109/EECSI.2017.8239090.
[21] Jiahui Pan, Yuanqing Li, and Jun Wang, “An EEG-Based brain-computer interface for emotion recognition,” in 2016 International Joint Conference on Neural Networks (IJCNN), 2016, pp. 2063–2067, doi: 10.1109/IJCNN.2016.7727453.
[22] M. Tariq, P. M. Trivailo, and M. Simic, “Motor-Imagery Based EEG Features Visualization for BCI Applications,” in Procedia Computer Science, 2018, vol. 126, pp. 1936–1944, doi: 10.1016/j.procs.2018.08.057.
[23] Y. Lin et al., “EEG based emotion recognition in music listening,” IEEE Trans. Biomed. Eng., vol. 57, no. 7, pp. 1798–1806, 2010, doi: 10.1109/TBME.2010.2048568.
[24] R. Duan, X.-W. Wang, and B.-L. Lu, “EEG-Based Emotion Recognition in Listening Music by Using Support Vector Machine and Linear Dynamic System,” in International Conference on Neural Information Processing, 2012, pp. 468–475, doi: 10.1007/978-3-642-34478-7_57.
[25] E. A. Mohamed, M. Z. B. Yusoff, N. K. Selman, and A. S. Malik, “Enhancing EEG Signals in Brain Computer Interface Using Wavelet Transform,” in International Journal of Information and Electronics Engineering, 2014, vol. 4, no. 3, pp. 234–238, doi: 10.7763/IJIEE.2014.V4.440.
[26] A. N. Akansu and R. A. Haddad, “Multiresolution signal decomposition,” 2001, Second., no. 1, pp. 22–25, doi: 10.1007/s13398-014-0173-7.2.
[27] J. Liu, Y. Cheng, and W. Zhang, “Deep learning EEG response representation for brain computer interface,” in Chinese Control Conference, 2015, pp. 3518–3523, doi: 10.1109/ChiCC.2015.7260182.
[28] H. Fadhilah, E. C. Djamal, and R. Ilyas, “Non-Halal Ingredients Detection of Food Packaging Image Using Convolutional Neural Networks,” in The 2018 International Symposium on Advanced Intelligent Informatics (SAIN 2018), 2018, doi: 10.1109/SAIN.2018.8673376.
[29] E. P. Giri, M. I. Fanany, A. M. Aryrnurthy, and S. K. Wijaya, “Ischemic Stroke Identification Based on EEG and EOG using 1D Convolutional Neural Network and Batch Normalization,” in 2016 International Conference on Advanced Computer Science and Information Systems (ICACSIS), 2016, pp. 484–491, doi: 10.1109/ICACSIS.2016.7872780.
[30] Y. L. Hsu, Y. T. Yang, J. S. Wang, and C. Y. Hsu, “Automatic Sleep Stage Recurrent Neural Classifier Using Energy Features of EEG signals,” Neurocomputing, vol. 104, pp. 105–114, 2013, doi: 10.1016/j.neucom.2012.11.003.
[31] Y. Shen, H. Lu, and J. Jia, “Classification of Motor Imagery EEG Signals with Deep Learning Models,” Lect. Notes Comput. Sci. B. Ser., vol. 10559, pp. 181–190, 2017, doi: 10.1007/978-3-319-67777-4_16.
[32] S. Alhagry, A. A. Fahmy, and R. A. El-Khoribi, “Emotion Recognition based on EEG using LSTM Recurrent Neural Network,” Int. J. Adv. Comput. Sci. Appl., vol. 8, no. 10, pp. 356–358, 2017, available at: Google Scholar.
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
___________________________________________________________
International Journal of Advances in Intelligent Informatics
ISSN 2442-6571 (print) | 2548-3161 (online)
Organized by UAD and ASCEE Computer Society
Published by Universitas Ahmad Dahlan
W: http://ijain.org
E: info@ijain.org (paper handling issues)
andri.pranolo.id@ieee.org (publication issues)
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0