Covid-19 detection from chest x-ray images: comparison of well-established convolutional neural networks models

(1) * Muhammad Amir As'ari Mail (Institute of Human Centered Engineering (IHCE), Universiti Teknologi Malaysia, Johor Bahru, Malaysia)
(2) Nur Izzaty Ab Manap Mail (School of Biomedical Engineering and Health Sciences, Universiti Teknologi Malaysia, Johor Bahru, Malaysia)
*corresponding author


Coronavirus disease 19 (Covid-19) is a pandemic disease that has already killed hundred thousands of people and infected millions more. At the climax disease Covid-19, this virus will lead to pneumonia and result in a fatality in extreme cases. COVID-19 provides radiological cues that can be easily detected using chest X-rays, which distinguishes it from other types of pneumonic disease. Recently, there are several studies using the CNN model only focused on developing binary classifier that classify between Covid-19 and normal chest X-ray. However, no previous studies have ever made a comparison between the performances of some of the established pre-trained CNN models that involving multi-classes including Covid-19, Pneumonia and Normal chest X-ray. Therefore, this study focused on formulating an automated system to detect Covid-19 from chest X-Ray images by four established and powerful CNN models AlexNet, GoogleNet, ResNet-18 and SqueezeNet and the performance of each of the models were compared. A total of 21,252 chest X-ray images from various sources were pre-processed and trained for the transfer learning-based classification task, which included Covid-19, bacterial pneumonia, viral pneumonia, and normal chest x-ray images. In conclusion, this study revealed that all models successfully classify Covid-19 and other pneumonia at an accuracy of more than 78.5%, and the test results revealed that GoogleNet outperforms other models for achieved accuracy of 91.0%, precision of 85.6%, sensitivity of 85.3%, and F1 score of 85.4%.



Article metrics

Abstract views : 258 | PDF views : 54




Full Text



[1] Ministry of Health (Malaysia), “Covid-19 (Maklumat Terkini),” Developed by Ministry Of Health for Malaysia, 2021. [Online]. Available at: [Accessed: 22-Jul-2021].

[2] Z. Y. Zu et al., “Coronavirus Disease 2019 (COVID-19): A Perspective from China,” Radiology, vol. 296, no. 2, pp. E15–E25, Aug. 2020, doi: 10.1148/radiol.2020200490.

[3] E. Asita, “COVID-19 outbreak in Malaysia,” Osong Public Heal. Res. Persptectives, vol. 11, no. 3, pp. 93–100, 2020. doi: 10.24171/j.phrp.2020.11.3.08

[4] A. Jacobi, M. Chung, A. Bernheim, and C. Eber, “Portable chest X-ray in coronavirus disease-19 (COVID-19): A pictorial review,” Clin. Imaging, vol. 64, pp. 35–42, Aug. 2020, doi: 10.1016/j.clinimag.2020.04.001.

[5] Z. Weng, “From Conventional Machine Learning to AutoML,” J. Phys. Conf. Ser., vol. 1207, pp. 1–10, Apr. 2019, doi: 10.1088/1742-6596/1207/1/012015.

[6] N. A. J. Sufri, N. A. Rahmad, N. F. Ghazali, N. Shahar, and M. A. As’ari, “Vision Based System for Banknote Recognition Using Different Machine Learning and Deep Learning Approach,” in 2019 IEEE 10th Control and System Graduate Research Colloquium (ICSGRC), 2019, pp. 5–8, doi: 10.1109/ICSGRC.2019.8837068.

[7] N. A. J. Sufri et al., “Image based ringgit banknote recognition for visually impaired,” J. Telecommun. Electron. Comput. Eng., vol. 9, no. 3–9, pp. 103–111, 2017. Available at: Google Scholar.

[8] C. Wang, M. Cheng, X. Hu, and J. Huang, “EasyASR: A Distributed Machine Learning Platform for End-to-end Automatic Speech Recognition,” Proc. AAAI Conf. Artif. Intell., vol. 35, no. 18, pp. 16111–16113, May 2021, doi: 10.1609/aaai.v35i18.18028.

[9] M. Elhoseny, “Multi-object Detection and Tracking (MODT) Machine Learning Model for Real-Time Video Surveillance Systems,” Circuits, Syst. Signal Process., vol. 39, no. 2, pp. 611–630, Feb. 2020, doi: 10.1007/s00034-019-01234-7.

[10] A. Pratondo, C.-K. Chui, and S.-H. Ong, “Integrating machine learning with region-based active contour models in medical image segmentation,” J. Vis. Commun. Image Represent., vol. 43, pp. 1–9, Feb. 2017, doi: 10.1016/j.jvcir.2016.11.019.

[11] C. H. Chau, J. D. Strope, and W. D. Figg, “COVID‐19 Clinical Diagnostics and Testing Technology,” Pharmacother. J. Hum. Pharmacol. Drug Ther., vol. 40, no. 8, pp. 857–868, Aug. 2020, doi: 10.1002/phar.2439.

[12] C.-C. Tsai, C.-K. Tseng, H.-C. Tang, and J.-I. Guo, “Vehicle Detection and Classification based on Deep Neural Network for Intelligent Transportation Applications,” in 2018 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC), 2018, pp. 1605–1608, doi: 10.23919/APSIPA.2018.8659542.

[13] C. Yao, X. Luo, Y. Zhao, W. Zeng, and X. Chen, “A review on image classification of remote sensing using deep learning,” in 2017 3rd IEEE International Conference on Computer and Communications (ICCC), 2017, pp. 1947–1955, doi: 10.1109/CompComm.2017.8322878.

[14] H. S. Abdullahi, R. E. Sheriff, and F. Mahieddine, “Convolution neural network in precision agriculture for plant image recognition and classification,” in 2017 Seventh International Conference on Innovative Computing Technology (INTECH), 2017, pp. 1–3, doi: 10.1109/INTECH.2017.8102436.

[15] D. Ravi et al., “Deep Learning for Health Informatics,” IEEE J. Biomed. Heal. Informatics, vol. 21, no. 1, pp. 4–21, Jan. 2017, doi: 10.1109/JBHI.2016.2636665.

[16] B. Khagi, B. Lee, J.-Y. Pyun, and G.-R. Kwon, “CNN Models Performance Analysis on MRI images of OASIS dataset for distinction between Healthy and Alzheimer’s patient,” in 2019 International Conference on Electronics, Information, and Communication (ICEIC), 2019, pp. 1–4, doi: 10.23919/ELINFOCOM.2019.8706339.

[17] Y. Li and L. Xia, “Coronavirus Disease 2019 (COVID-19): Role of Chest CT in Diagnosis and Management,” Am. J. Roentgenol., vol. 214, no. 6, pp. 1280–1286, Jun. 2020, doi: 10.2214/AJR.20.22954.

[18] P. M. Krishnammal and S. S. Raja, “Convolutional Neural Network based Image Classification and Detection of Abnormalities in MRI Brain Images,” in 2019 International Conference on Communication and Signal Processing (ICCSP), 2019, pp. 0548–0553, doi: 10.1109/ICCSP.2019.8697915.

[19] N. Abiwinanda, M. Hanif, S. T. Hesaputra, A. Handayani, and T. R. Mengko, “Brain Tumor Classification Using Convolutional Neural Network.” pp. 183–189, 2019, doi: 10.1007/978-981-10-9035-6_33.

[20] A. Narin, C. Kaya, and Z. Pamuk, “Automatic detection of coronavirus disease (COVID-19) using X-ray images and deep convolutional neural networks,” Pattern Anal. Appl., vol. 24, no. 3, pp. 1207–1220, Aug. 2021, doi: 10.1007/s10044-021-00984-y.

[21] I. D. Apostolopoulos and T. A. Mpesiana, “Covid-19: automatic detection from X-ray images utilizing transfer learning with convolutional neural networks,” Phys. Eng. Sci. Med., vol. 43, no. 2, pp. 635–640, Jun. 2020, doi: 10.1007/s13246-020-00865-4.

[22] A. Shelke et al., “Chest X-ray classification using deep learning for automated COVID-19 screening,” SN Comput. Sci., vol. 2, no. 4, pp. 1–9, 2021, doi: 10.1101/2020.06.21.20136598.

[23] T. Ozturk, M. Talo, E. A. Yildirim, U. B. Baloglu, O. Yildirim, and U. Rajendra Acharya, “Automated detection of COVID-19 cases using deep neural networks with X-ray images,” Comput. Biol. Med., vol. 121, p. 103792, Jun. 2020, doi: 10.1016/j.compbiomed.2020.103792.

[24] A. Alqudah, S. Qazan, H. Alquran, I. Qasmieh, and A. Alqudah, “COVID-19 Detection from X-ray Images Using Different Artificial Intelligence Hybrid Models,” Jordan J. Electr. Eng., vol. 6, no. 2, pp. 168–178, 2020, doi: 10.5455/jjee.204-1585312246.

[25] P. K. Sethy and S. K. Behera, “Detection of coronavirus disease (covid-19) based on deep features.” MDPI AG, Odisha, pp. 1–10, 2020. doi: 10.20944/preprints202003.0300.v1

[26] J. P. Cohen, P. Morrison, L. Dao, K. Roth, T. Q. Duong, and M. Ghassemi, “Covid-19 image data collection: Prospective predictions are the future,” J. Mach. Learn. Biomed. Imagin, vol. 2, no. 12, pp. 1–38, 2020. Available at: Google Scholar.

[27] P. Mooney, “Chest X-Ray Images (Pneumonia),” Kaggle, 2019. [Online]. Available at: [Accessed: 22-Jul-2021].

[28] A. K. Tawsifur Rahman, Muhammad Chowdhury, “COVID-19 Radiography Database,” Kaggle, 2021. [Online]. Available at: [Accessed: 22-Jul-2021].

[29] Radiological Society of North America, “RSNA Pneumonia Detection Challenge:Can you build an algorithm that automatically detects potential pneumonia cases?,” Kaggle, 2020. [Online]. Available at: [Accessed: 22-Jul-2021].

[30] BIMCV-COVID19, “Datasets related to COVID19’s pathology course,” BIMCV-CSUSP, 2020. [Online]. Available at: [Accessed: 22-Jul-2021].

[31] G. Hub, “Open database of COVID-19 cases with chest X-ray or CT images,” 2022. [Online]. Available at:

[32] Tawsifur Rahman, “COVID-19 Radiography Database,” Kaggle, 2021. [Online]. Available at: [Accessed: 22-Jul-2021].

[33] Paul Mooney, “Chest X-Ray Images (Pneumonia),” Kaggle, 2018. [Online]. Available at:

[34] T. Rahman et al., “Transfer Learning with Deep Convolutional Neural Network (CNN) for Pneumonia Detection Using Chest X-ray,” Appl. Sci., vol. 10, no. 9, pp. 1–17, May 2020, doi: 10.3390/app10093233.

[35] O. Stephen, M. Sain, U. J. Maduh, and D.-U. Jeong, “An Efficient Deep Learning Approach to Pneumonia Classification in Healthcare,” J. Healthc. Eng., vol. 2019, pp. 1–7, Mar. 2019, doi: 10.1155/2019/4180949.

[36] Y. LeCun, Y. Bengio, and G. Hinton, “Deep learning,” Nature, vol. 521, no. 7553, pp. 436–444, May 2015, doi: 10.1038/nature14539.

[37] A. Shoeibi et al., “Automated detection and forecasting of covid-19 using deep learning techniques: A review,” Preprint arXiv. pp. 1–20, 2020, doi: 10.48550/arXiv.2007.10785.

[38] X. Yu and S.-H. Wang, “Abnormality Diagnosis in Mammograms by Transfer Learning Based on ResNet18,” Fundam. Informaticae, vol. 168, no. 2–4, pp. 219–230, Sep. 2019, doi: 10.3233/FI-2019-1829.

[39] M. Farooq and A. Hafeez, “Covid-resnet: A deep learning framework for screening of covid19 from radiographs,” Preprint arXiv. pp. 1–5, 2020, doi: 10.48550/arXiv.2003.14395.

[40] O. Sidorov, “Artificial Color Constancy via GoogLeNet with Angular Loss Function,” Appl. Artif. Intell., vol. 34, no. 9, pp. 643–655, Jul. 2020, doi: 10.1080/08839514.2020.1730630.

[41] D. Zhao et al., “A Comparative Study on the Clinical Features of Coronavirus 2019 (COVID-19) Pneumonia With Other Pneumonias,” Clin. Infect. Dis., vol. 71, no. 15, pp. 756–761, Jul. 2020, doi: 10.1093/cid/ciaa247.

[42] F. N. Iandola, S. Han, M. W. Moskewicz, K. Ashraf, W. J. Dally, and K. Keutzer, “SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and< 0.5 MB model size,” in ICLR, 2016, pp. 1–13, doi: 10.48550/arXiv.1602.07360.

[43] A. Canziani, A. Paszke, and E. Culurciello, “An analysis of deep neural network models for practical applications,” Preprint arXiv. pp. 1–7, 2016. Available at: Google Scholar.

Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

International Journal of Advances in Intelligent Informatics
ISSN 2442-6571  (print) | 2548-3161 (online)
Organized by UAD and ASCEE Computer Society
Published by Universitas Ahmad Dahlan
E: (paper handling issues) (publication issues)

View IJAIN Stats

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0