
(2) Anh-Cang Phan

*corresponding author
AbstractA significant increase in the size of the medical data, as well as the complexity of medical diagnosis, poses challenges to processing this data in a reasonable time. The use of big data is expected to have the upper hand in managing the large-scale datasets. This research presents the detection and prediction of lung diseases using big data and deep learning techniques. In this work, we train neural networks based on Faster R-CNN and RetinaNet with different backbones (ResNet, CheXNet, and Inception ResNet V2) for lung disease classification in a distributed and parallel processing environment. Moreover, we also experimented with three new network architectures on the medical image dataset: CTXNet, Big Transfer (BiT), and Swin Transformer, to evaluate their accuracy and training time in a distributed environment. We provide ten scenarios in two types of processing environments to compare and find the most promising scenarios that can be used for the detection of lung diseases on chest X-rays. The results show that the proposed method can accurately detect and classify lung lesions on chest X-rays with an accuracy of up to 96%. Additionally, we use Grad-CAM to highlight lung lesions, thus radiologists can clearly see the lesions’ location and size without much effort. The proposed method allows for reducing the costs of time, space, and computing resources. It will be of great significance to reduce workloads, increase the capacity of medical examinations, and improve health facilities.
KeywordsBig data; Spark; Lung diseases classification; Deep learning; Medical imaging
|
DOIhttps://doi.org/10.26555/ijain.v11i2.1828 |
Article metricsAbstract views : 832 | PDF views : 119 |
Cite |
Full Text![]() |
References
[1] E. Hussain, M. Hasan, M. A. Rahman, I. Lee, T. Tamanna, and M. Z. Parvez, “CoroDet: A deep learning based classification for COVID-19 detection using chest X-ray images,” Chaos, Solitons & Fractals, vol. 142, p. 110495, Jan. 2021, doi: 10.1016/j.chaos.2020.110495.
[2] A. Narin, C. Kaya, and Z. Pamuk, “Automatic detection of coronavirus disease (COVID-19) using X-ray images and deep convolutional neural networks,” Pattern Anal. Appl., vol. 24, no. 3, pp. 1207–1220, Aug. 2021, doi: 10.1007/s10044-021-00984-y.
[3] R. Jain, P. Nagrath, G. Kataria, V. Sirish Kaushik, and D. Jude Hemanth, “Pneumonia detection in chest X-ray images using convolutional neural networks and transfer learning,” Measurement, vol. 165, p. 108046, Dec. 2020, doi: 10.1016/j.measurement.2020.108046.
[4] K. El Asnaoui and Y. Chawki, “Using X-ray images and deep learning for automated detection of coronavirus disease,” J. Biomol. Struct. Dyn., vol. 39, no. 10, pp. 3615–3626, Jul. 2021, doi: 10.1080/07391102.2020.1767212.
[5] L. Sarker, M. M. Islam, T. Hannan, and Z. Ahmed, “COVID-DenseNet: A Deep Learning Architecture to Detect COVID-19 from Chest Radiology Images,” Preprints, p. 5, May 2020, doi: 10.20944/preprints202005.0151.v1.
[6] Z. Liu et al., “Swin Transformer: Hierarchical Vision Transformer using Shifted Windows,” in 2021 IEEE/CVF International Conference on Computer Vision (ICCV), Oct. 2021, pp. 9992–10002, doi: 10.1109/ICCV48922.2021.00986.
[7] A. Kolesnikov et al., “Big Transfer (BiT): General Visual Representation Learning,” in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 12350 LNCS, Springer, Cham, 2020, pp. 491–507, doi: 10.1007/978-3-030-58558-7_29.
[8] N. Habib, M. M. Hasan, M. M. Reza, and M. M. Rahman, “Ensemble of CheXNet and VGG-19 Feature Extractor with Random Forest Classifier for Pediatric Pneumonia Detection,” SN Comput. Sci., vol. 1, no. 6, p. 359, Nov. 2020, doi: 10.1007/s42979-020-00373-y.
[9] M. Z. Hasan et al., “Fast and Efficient Lung Abnormality Identification With Explainable AI: A Comprehensive Framework for Chest CT Scan and X-Ray Images,” IEEE Access, vol. 12, pp. 31117–31135, 2024, doi: 10.1109/ACCESS.2024.3369900.
[10] E. E. Khaing and T. Z. Aung, “Lung Disease Classification from Chest X-ray Images Using Convolutional Neural Network and Long Short-Term Memory Model,” in 2024 3rd International Conference on Artificial Intelligence For Internet of Things (AIIoT), May 2024, pp. 1–6, doi: 10.1109/AIIoT58432.2024.10574623.
[11] R. N. Sadoon and A. M. Chaid, “Deep Learning Technique for The Classification of Lung Diseases from X-ray Images,” J. Al-Qadisiyah Comput. Sci. Math., vol. 16, no. 2, pp. 70-83–70–83, Jun. 2024, doi: 10.29304/jqcsm.2024.16.21544.
[12] K. S, R. S. Shudapreyaa, P. Prakash, V. S, V. V, and Y. S, “Classification of Lung Diseases Using Transfer Learning with Chest X-Ray Images,” in 2024 Second International Conference on Emerging Trends in Information Technology and Engineering (ICETITE), Feb. 2024, pp. 1–6, doi: 10.1109/ic-ETITE58242.2024.10493367.
[13] R. H, T. Kumaravel, P. Natesan, B. B M, S. Sangeetha, and S. Dharanesh, “Comparative Study of Deep Learning Techniques for Automated Classification of Lung Diseases,” in 2023 4th International Conference on Smart Electronics and Communication (ICOSEC), Sep. 2023, pp. 1324–1328, doi: 10.1109/ICOSEC58147.2023.10276053.
[14] J. Bhookya, “Examine Lung Disorders and Disease Classification Using Advanced CNN Approach,” in 2023 3rd Asian Conference on Innovation in Technology (ASIANCON), Aug. 2023, pp. 1–6, doi: 10.1109/ASIANCON58793.2023.10270338.
[15] A. N. Patel et al., “An explainable transfer learning framework for multi-classification of lung diseases in chest X-rays,” Alexandria Eng. J., vol. 98, pp. 328–343, Jul. 2024, doi: 10.1016/j.aej.2024.04.072.
[16] A. Ali, Y. Wang, and X. Shi, “Detection of multi‐class lung diseases based on customized neural network,” Comput. Intell., vol. 40, no. 2, p. e12649, Apr. 2024, doi: 10.1111/coin.12649.
[17] P. T. P and P. M. Arabi, “Computer Aided Classification of Lung Cancer, Ground Glass Lung and Pulmonary Fibrosis Using Machine Learning and KNN Classifier,” Int. J. Adv. Comput. Sci. Appl., vol. 15, no. 7, pp. 1145–1151, Jun. 2024, doi: 10.14569/IJACSA.2024.01507111.
[18] Y. C. A. P. Reddy, S. L. Vemuri, T. P. Mahan, V. S. Teja, and V. Anil, “A Semi-Supervised Deep Learning Approach for Detection and Classification of Lung Diseases,” in 2023 IEEE Silchar Subsection Conference (SILCON), Nov. 2023, pp. 1–6, doi: 10.1109/SILCON59133.2023.10404180.
[19] P. Rana, V. Sharma, and P. Kumar Gupta, “Lung Disease Classification using Dense Alex Net Framework with Contrast Normalisation and Five-Fold Geometric Transformation,” Int. J. Recent Innov. Trends Comput. Commun., vol. 11, no. 2, pp. 94–105, Mar. 2023, doi: 10.17762/ijritcc.v11i2.6133.
[20] A. Gupta and A. Kumar, “Deep-Learning Based Hybrid Model For The Classification of Lung Diseases,” in 2022 4th International Conference on Artificial Intelligence and Speech Technology (AIST), Dec. 2022, pp. 1–4, doi: 10.1109/AIST55798.2022.10065198.
[21] X. Fu, R. Lin, W. Du, A. Tavares, and Y. Liang, “Explainable hybrid transformer for multi-classification of lung disease using chest X-rays,” Sci. Rep., vol. 15, no. 1, p. 6650, Feb. 2025, doi: 10.1038/s41598-025-90607-x.
[22] B. Koonce, “ResNet 50,” in Convolutional Neural Networks with Swift for Tensorflow, Berkeley, CA: Apress, 2021, pp. 63–72, doi: 10.1007/978-1-4842-6168-2_6.
[23] A. S. Al-Waisy et al., “RETRACTED ARTICLE: COVID-CheXNet: hybrid deep learning framework for identifying COVID-19 virus in chest X-rays images,” Soft Comput., vol. 27, no. 5, pp. 2657–2672, Mar. 2023, doi: 10.1007/s00500-020-05424-3.
[24] G. Huang, Z. Liu, L. Van Der Maaten, and K. Q. Weinberger, “Densely Connected Convolutional Networks,” in 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Jul. 2017, vol. 2017-Janua, pp. 2261–2269, doi: 10.1109/CVPR.2017.243.
[25] C. Peng, Y. Liu, X. Yuan, and Q. Chen, “Research of image recognition method based on enhanced inception-ResNet-V2,” Multimed. Tools Appl., vol. 81, no. 24, pp. 34345–34365, Oct. 2022, doi: 10.1007/s11042-022-12387-0.
[26] C. Szegedy, V. Vanhoucke, S. Ioffe, J. Shlens, and Z. Wojna, “Rethinking the Inception Architecture for Computer Vision,” in 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Jun. 2016, vol. 2016-Decem, pp. 2818–2826, doi: 10.1109/CVPR.2016.308.
[27] S. Ren, K. He, R. Girshick, and J. Sun, “Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 39, no. 6, pp. 1137–1149, Jun. 2017, doi: 10.1109/TPAMI.2016.2577031.
[28] L. Tan, T. Huangfu, L. Wu, and W. Chen, “Comparison of RetinaNet, SSD, and YOLO v3 for real-time pill identification,” BMC Med. Inform. Decis. Mak., vol. 21, no. 1, p. 324, Dec. 2021, doi: 10.1186/s12911-021-01691-8.
[29] S. M. Pizer et al., “Adaptive histogram equalization and its variations,” Comput. Vision, Graph. Image Process., vol. 39, no. 3, pp. 355–368, Sep. 1987, doi: 10.1016/S0734-189X(87)80186-X.
[30] R. R. Selvaraju, M. Cogswell, A. Das, R. Vedantam, D. Parikh, and D. Batra, “Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization,” Int. J. Comput. Vis., vol. 128, no. 2, pp. 336–359, Feb. 2020, doi: 10.1007/s11263-019-01228-7.
[31] S. Woo, J. Park, J.-Y. Lee, and I. S. Kweon, “CBAM: Convolutional Block Attention Module,” in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 11211 LNCS, Springer Verlag, 2018, pp. 3–19, doi: 10.1007/978-3-030-01234-2_1.
[32] “NIH Chest X-rays,” Kaggle, 2018. [Online]. Available at: https://www.kaggle.com/datasets/nih-chest-xrays/data.

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
___________________________________________________________
International Journal of Advances in Intelligent Informatics
ISSN 2442-6571 (print) | 2548-3161 (online)
Organized by UAD and ASCEE Computer Society
Published by Universitas Ahmad Dahlan
W: http://ijain.org
E: info@ijain.org (paper handling issues)
andri.pranolo.id@ieee.org (publication issues)
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0