Evaluation of sleep stage classification using feature importance of EEG signal for big data healthcare

(1) * Mera Kartika Delimayanti Mail (Department of Computer and Informatics Engineering, Politeknik Negeri Jakarta, Indonesia)
(2) Mauldy Laya Mail (Department of Computer and Informatics Engineering, Politeknik Negeri Jakarta, Indonesia)
(3) Anggi Mardiyono Mail (Department of Computer and Informatics Engineering, Politeknik Negeri Jakarta, Indonesia)
(4) Bambang Warsuta Mail (Department of Computer and Informatics Engineering, Politeknik Negeri Jakarta, Indonesia)
(5) Reisa Siva Nandika Mail (Department of Computer and Informatics Engineering, Politeknik Negeri Jakarta, Indonesia)
(6) Mohammad Reza Faisal Mail (Department of Computer Science, Lambung Mangkurat University, Indonesia)
*corresponding author


Sleep analysis is widely and experimentally considered due to its importance to body health care. Since its sufficiency is essential for a healthy life, people often spend almost a third of their lives sleeping. In this case, a similar sleep pattern is not practiced by every individual, regarding pure healthiness or disorders such as insomnia, apnea, bruxism, epilepsy, and narcolepsy. Therefore, this study aims to determine the classification patterns of sleep stages, using big data for health care. This used a high-dimensional FFT extraction algorithm, as well as a feature importance and tuning classifier, to develop accurate classification. The results showed that the proposed method led to more accurate classification than previous techniques. This was because the previous experiments had been conducted with the feature selection model, with accuracy implemented as a performance evaluation. Meanwhile, the EEG Sleep Stages classification model in this present report was composed of the feature selection and importance of the extraction stage. The previous and present experiments also reached the highest values of accuracy, with the Random Forest and SVM models using 2000 and 3000 features (87.19% and 89.19%, respectively. In this article, we proposed an analysis that the feature importance subsequently influenced the model's accuracy. This was because the proposed method was easily fine-tuned and optimized for each subject to improve sensitivity and reduce false negative occurrences.


EEG Signal; Features Importance; Fine Tuning; Sleep Stages; Sleep-EDF




Article metrics

Abstract views : 270 | PDF views : 65




Full Text



[1] S. Santaji and V. Desai, “Analysis of EEG Signal to Classify Sleep Stages Using Machine Learning,” Sleep Vigil., vol. 4, no. 2, pp. 145–152, Dec. 2020, doi: 10.1007/S41782-020-00101-9.

[2] V. Gurrala, P. Yarlagadda, and P. Koppireddi, “Detection of Sleep Apnea based on the analysis of sleep stages data using single channel EEG,” Trait. du Signal, vol. 38, no. 2, pp. 431–436, Apr. 2021, doi: 10.18280/TS.380221.

[3] L. J. Anbarasi, M. Jawahar, V. Ravi, S. M. Cherian, S. Shreenidhi, and H. Sharen, “Machine learning approach for anxiety and sleep disorders analysis during COVID-19 lockdown,” Health Technol. (Berl)., vol. 12, no. 4, pp. 825–838, Jul. 2022, doi: 10.1007/S12553-022-00674-7.

[4] L. X. Feng et al., “Automatic Sleep Staging Algorithm Based on Time Attention Mechanism,” Front. Hum. Neurosci., vol. 15, p. 692054, Aug. 2021, doi: 10.3389/FNHUM.2021.692054.

[5] S. W. Kim, K. Lee, J. Yeom, T. H. Lee, D. H. Kim, and J. J. Kim, “Wearable Multi-Biosignal Analysis Integrated Interface with Direct Sleep-Stage Classification,” IEEE Access, vol. 8, pp. 46131–46140, 2020, doi: 10.1109/ACCESS.2020.2978391.

[6] M. K. Delimayanti et al., “Classification of Brainwaves for Sleep Stages by High-Dimensional FFT Features from EEG Signals,” Appl. Sci. 2020, vol. 10, no. 5, p. 1797, Mar. 2020, doi: 10.3390/APP10051797.

[7] M. Kartika Delimayanti, M. Laya, M. Reza Faisal, R. Fitri Naryanto, and K. Satou, “The Effect of Feature Selection on Automatic Sleep Stage Classification Based on Multichannel EEG Signals,” Proc. - 2021 IEEE 5th Int. Conf. Inf. Technol. Inf. Syst. Electr. Eng. Appl. Data Sci. Artif. Intell. Technol. Glob. Challenges Dur. Pandemic Era, ICITISEE 2021, pp. 272–276, 2021, doi: 10.1109/ICITISEE53823.2021.9655784.

[8] R. K. Tripathy and U. Rajendra Acharya, “Use of features from RR-time series and EEG signals for automated classification of sleep stages in deep neural network framework,” Biocybern. Biomed. Eng., vol. 38, no. 4, pp. 890–902, Jan. 2018, doi: 10.1016/J.BBE.2018.05.005.

[9] R. K. Tripathy, S. K. Ghosh, P. Gajbhiye, and U. R. Acharya, “Development of Automated Sleep Stage Classification System Using Multivariate Projection-Based Fixed Boundary Empirical Wavelet Transform and Entropy Features Extracted from Multichannel EEG Signals,” Entropy 2020, vol. 22, no. 10, p. 1141, Oct. 2020, doi: 10.3390/E22101141.

[10] S. Taran, P. C. Sharma, and V. Bajaj, “Automatic sleep stages classification using optimize flexible analytic wavelet transform,” Knowledge-Based Syst., vol. 192, p. 105367, Mar. 2020, doi: 10.1016/J.KNOSYS.2019.105367.

[11] M. Nassralla, M. Haidar, H. Alawieh, A. El Hajj, and Z. Dawy, “Patient-Aware EEG-Based Feature and Classifier Selection for e-Health Epileptic Seizure Prediction,” 2018 IEEE Glob. Commun. Conf. GLOBECOM 2018 - Proc., pp. 1-6, 2018, doi: 10.1109/GLOCOM.2018.8647660.

[12] H. W. Loh et al., “Automated Detection of Sleep Stages Using Deep Learning Techniques: A Systematic Review of the Last Decade (2010–2020),” Appl. Sci. 2020, vol. 10, no. 24, p. 8963, Dec. 2020, doi: 10.3390/APP10248963.

[13] E. P. Torres, E. A. Torres, M. Hernández-Álvarez, and S. G. Yoo, “Emotion Recognition Related to Stock Trading Using Machine Learning Algorithms with Feature Selection,” IEEE Access, vol. 8, pp. 199719–199732, 2020, doi: 10.1109/ACCESS.2020.3035539.

[14] C. Liu et al., “Automatic sleep staging with a single-channel EEG based on ensemble empirical mode decomposition,” Phys. A Stat. Mech. its Appl., vol. 567, p. 125685, Apr. 2021, doi: 10.1016/J.PHYSA.2020.125685.

[15] G. A. Lujan-Moreno, P. R. Howard, O. G. Rojas, and D. C. Montgomery, “Design of experiments and response surface methodology to tune machine learning hyperparameters, with a random forest case-study,” Expert Syst. Appl., vol. 109, pp. 195–205, Nov. 2018, doi: 10.1016/J.ESWA.2018.05.024.

[16] P. Probst, M. N. Wright, and A. L. Boulesteix, “Hyperparameters and tuning strategies for random forest,” Wiley Interdiscip. Rev. Data Min. Knowl. Discov., vol. 9, no. 3, p. e1301, May 2019, doi: 10.1002/WIDM.1301.

[17] P. Martinek, B. Illés, N. Codreanu, and O. Krammer, “Investigating Machine Learning Techniques for Predicting the Process Characteristics of Stencil Printing,” Mater. 2022, vol. 15, no. 14, p. 4734, Jul. 2022, doi: 10.3390/MA15144734.

[18] B. Kemp, A. Zwinderman, B. Tuk, H. Kamphuisen, and J. Oberyé, “The Sleep-EDF Database [Expanded],” IEEE-BME, vol. 47, no. 9, pp. 1185–1194, 2000, Available: https://archive.physionet.org/physiobank/database/sleep-edfx/

[19] J. Wang and M. Wang, “Review of the emotional feature extraction and classification using EEG signals,” Cogn. Robot., vol. 1, pp. 29–40, Jan. 2021, doi: 10.1016/J.COGR.2021.04.001.

[20] M. Ravan and M. Ravan, “A machine learning approach using EEG signals to measure sleep quality,” AIMS Electron. Electr. Eng. 2019 4347, vol. 3, no. 4, pp. 347–358, Nov. 2019, doi: 10.3934/ELECTRENG.2019.4.347.

[21] C. G. Cordoba and C. J. Daly, “The organisation of vascular smooth muscle cells; a quantitative Fast Fourier Transform (FFT) based assessment,” Transl. Res. Anat., vol. 16, p. 100047, Sep. 2019, doi: 10.1016/J.TRIA.2019.100047.

[22] X. Yan and M. Jia, “A novel optimized SVM classification algorithm with multi-domain feature and its application to fault diagnosis of rolling bearing,” Neurocomputing, vol. 313, pp. 47–64, Nov. 2018, doi: 10.1016/J.NEUCOM.2018.05.002.

[23] Z. Zhou and G. Hooker, “Unbiased Measurement of Feature Importance in Tree-Based Methods,” ACM Trans. Knowl. Discov. from Data, vol. 15, no. 2, pp. 1-21, Jan. 2021, doi: 10.1145/3429445.

[24] J. Sánchez Almeida, J. A. L. Aguerri, and C. Muñoz-Tuñón, “Facemask Detection using Inception V3 Model and Effect on Accuracy of Data Preprocessing Methods,” J. Phys. Conf. Ser., vol. 2010, no. 1, p. 012052, Sep. 2021, doi: 10.1088/1742-6596/2010/1/012052.

[25] H. Nguyen, X. N. Bui, Y. Choi, C. W. Lee, and D. J. Armaghani, “A Novel Combination of Whale Optimization Algorithm and Support Vector Machine with Different Kernel Functions for Prediction of Blasting-Induced Fly-Rock in Quarry Mines,” Nat. Resour. Res., vol. 30, no. 1, pp. 191–207, Feb. 2021, doi: 10.1007/S11053-020-09710-7.

[26] M. K. Delimayanti, R. Sari, M. Laya, M. R. Faisal, Pahrul, and R. F. Naryanto, “The effect of pre-processing on the classification of twitter’s flood disaster messages using support vector machine algorithm,” 2020 3rd International Conference on Applied Engineering (ICAE), Batam, Indonesia, 2020, pp. 1-6, doi: 10.1109/ICAE50557.2020.9350387.

[27] M. Fuchida, T. Pathmakumar, R. E. Mohan, N. Tan, and A. Nakamura, “Vision-Based Perception and Classification of Mosquitoes Using Support Vector Machine,” Appl. Sci. 2017, vol. 7, no. 1, p. 51, Jan. 2017, doi: 10.3390/APP7010051.

[28] Riandini and M. K. Delimayanti, “Feature extraction and classification of thorax x-ray image in the assessment of osteoporosis,” 2017 4th International Conference on Electrical Engineering, Computer Science and Informatics (EECSI), Yogyakarta, Indonesia, pp. 1-5, Dec. 2017, doi: 10.1109/EECSI.2017.8239102.

[29] N. Surantha, T. F. Lesmana, and S. M. Isa, “Sleep stage classification using extreme learning machine and particle swarm optimization for healthcare big data,” J. Big Data, vol. 8, no. 1, pp. 1–17, Dec. 2021, doi: 10.1186/S40537-020-00406-6.

[30] M. Heidari, S. Mirniaharikandehei, A. Z. Khuzani, G. Danala, Y. Qiu, and B. Zheng, “Improving the performance of CNN to predict the likelihood of COVID-19 using chest X-ray images with preprocessing algorithms,” Int. J. Med. Inform., vol. 144, p. 104284, Dec. 2020, doi: 10.1016/J.IJMEDINF.2020.104284.

[31] N. S. Suhaimi, J. Mountstephens, and J. Teo, “A Dataset for Emotion Recognition Using Virtual Reality and EEG (DER-VREEG): Emotional State Classification Using Low-Cost Wearable VR-EEG Headsets,” Big Data Cogn. Comput. 2022, vol. 6, no. 1, p. 16, Jan. 2022, doi: 10.3390/BDCC6010016.

Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

International Journal of Advances in Intelligent Informatics
ISSN 2442-6571  (print) | 2548-3161 (online)
Organized by UAD and ASCEE Computer Society
Published by Universitas Ahmad Dahlan
W: http://ijain.org
E: info@ijain.org (paper handling issues)
   andri.pranolo.id@ieee.org (publication issues)

View IJAIN Stats

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0