A hybrid ensemble deep learning approach for reliable breast cancer detection

(1) * Mohamed Abdelmoneim Elshafey Mail (Military Technical College (MTC), Egypt)
(2) Tarek Elsaid Ghoniemy Mail (Military Technical College (MTC), Egypt)
*corresponding author


Among the cancer diseases, breast cancer is considered one of the most prevalent threats requiring early detection for a higher recovery rate. Meanwhile, the manual evaluation of malignant tissue regions in histopathology images is a critical and challenging task. Nowadays, deep learning becomes a leading technology for automatic tumor feature extraction and classification as malignant or benign. This paper presents a proposed hybrid deep learning-based approach, for reliable breast cancer detection, in three consecutive stages: 1) fine-tuning the pre-trained Xception-based classification model, 2) merging the extracted features with the predictions of a two-layer stacked LSTM-based regression model, and finally, 3) applying the support vector machine, in the classification phase, to the merged features. For the three stages of the proposed approach, training and testing phases are performed on the BreakHis dataset with nine adopted different augmentation techniques to ensure generalization of the proposed approach. A comprehensive performance evaluation of the proposed approach, with diverse metrics, shows that employing the LSTM-based regression model improves accuracy and precision metrics of the fine-tuned Xception-based model by 10.65% and 11.6%, respectively. Additionally, as a classifier, implementing the support vector machine further boosts the model by 3.43% and 5.22% for both metrics, respectively. Experimental results exploit the efficiency of the proposed approach with outstanding reliability in comparison with the recent state-of-the-art approaches.


Breast Cancer Detection; Transfer Learning; Xception; LSTM; Support Vector Machine; Precision




Article metrics

Abstract views : 225 | PDF views : 67




Full Text



[1] L. A. Torre, R. L. Siegel, E. M. Ward, and A. Jemal, "Global Cancer Incidence and Mortality Rates and Trends—An Update," Cancer Epidemiol. Biomarkers Prev., vol. 25, no. 1, pp. 16–27, Jan. 2016, doi: 10.1158/1055-9965.EPI-15-0578.

[2] K. G. Kim, "Book Review: Deep Learning," Healthc. Inform. Res., vol. 22, no. 4, p. 351, 2016, doi: 10.4258/hir.2016.22.4.351.

[3] T. G. Debelee, F. Schwenker, A. Ibenthal, and D. Yohannes, “Survey of deep learning in breast cancer image analysis,” Evol. Syst., vol. 11, no. 1, pp. 143–163, Mar. 2020, doi: 10.1007/s12530-019-09297-2.

[4] T. G. Debelee, S. R. Kebede, F. Schwenker, and Z. M. Shewarega, "Deep Learning in Selected Cancers' Image Analysis—A Survey," J. Imaging, vol. 6, no. 11, p. 121, Nov. 2020, doi: 10.3390/jimaging6110121.

[5] Y. Xue, S. Chen, J. Qin, Y. Liu, B. Huang, and H. Chen, "Application of Deep Learning in Automated Analysis of Molecular Images in Cancer: A Survey," Contrast Media Mol. Imaging, vol. 2017, pp. 1–10, 2017, doi: 10.1155/2017/9512370.

[6] H. Dhahri, E. Al Maghayreh, A. Mahmood, W. Elkilani, and M. Faisal Nagi, "Automated Breast Cancer Diagnosis Based on Machine Learning Algorithms," J. Healthc. Eng., vol. 2019, pp. 1–11, Nov. 2019, doi: 10.1155/2019/4253641.

[7] F. A. Spanhol, L. S. Oliveira, C. Petitjean, and L. Heutte, "Breast cancer histopathological image classification using Convolutional Neural Networks," in 2016 International Joint Conference on Neural Networks (IJCNN), 2016, pp. 2560–2567, doi: 10.1109/IJCNN.2016.7727519.

[8] Shallu and R. Mehra, "Breast cancer histology images classification: Training from scratch or transfer learning?," ICT Express, vol. 4, no. 4, pp. 247–254, Dec. 2018, doi: 10.1016/j.icte.2018.10.007.

[9] J. de Matos, A. de S. Britto, L. E. S. Oliveira, and A. L. Koerich, "Double Transfer Learning for Breast Cancer Histopathologic Image Classification," in 2019 International Joint Conference on Neural Networks (IJCNN), 2019, pp. 1–8, doi: 10.1109/IJCNN.2019.8852092.

[10] P. J. Sudharshan, C. Petitjean, F. Spanhol, L. E. Oliveira, L. Heutte, and P. Honeine, "Multiple instance learning for histopathological breast cancer image classification," Expert Syst. Appl., vol. 117, pp. 103–111, Mar. 2019, doi: 10.1016/j.eswa.2018.09.049.

[11] G. Murtaza et al., "Breast cancer classification using digital biopsy histopathology images through transfer learning," J. Phys. Conf. Ser., vol. 1339, p. 012035, Dec. 2019, doi: 10.1088/1742-6596/1339/1/012035.

[12] S. H. Kassani, P. H. Kassani, M. J. Wesolowski, K. A. Schneider, and R. Deters, "Breast Cancer Diagnosis with Transfer Learning and Global Pooling," in 2019 International Conference on Information and Communication Technology Convergence (ICTC), 2019, pp. 519–524, doi: 10.1109/ICTC46691.2019.8939878.

[13] Y. J. Suh, J. Jung, and B.-J. Cho, "Automated Breast Cancer Detection in Digital Mammograms of Various Densities via Deep Learning," J. Pers. Med., vol. 10, no. 4, p. 211, Nov. 2020, doi: 10.3390/jpm10040211.

[14] M. U. Dalmış, S. Vreemann, T. Kooi, R. M. Mann, N. Karssemeijer, and A. Gubern-Mérida, "Fully automated detection of breast cancer in screening MRI using convolutional neural networks," J. Med. Imaging, vol. 5, no. 01, p. 1, Jan. 2018, doi: 10.1117/1.JMI.5.1.014502.

[15] Z. M. Zain et al., "Predicting breast cancer recurrence using principal component analysis as feature extraction: an unbiased comparative analysis," Int. J. Adv. Intell. Informatics, vol. 6, no. 3, p. 313, Nov. 2020, doi: 10.26555/ijain.v6i3.462.

[16] K.-H. Yu et al., "Predicting non-small cell lung cancer prognosis by fully automated microscopic pathology image features," Nat. Commun., vol. 7, no. 1, p. 12474, Nov. 2016, doi: 10.1038/ncomms12474.

[17] G. Csurka, C. R. Dance, and M. Humenberger, "From hand-crafted to deep local features," arXiv Prepr. arXiv1807.10254, 2018. Available at: Google Scholar.

[18] R. Zemouri, N. Zerhouni, and D. Racoceanu, "Deep Learning in the Biomedical Applications: Recent and Future Status," Appl. Sci., vol. 9, no. 8, p. 1526, Apr. 2019, doi: 10.3390/app9081526.

[19] A. Krizhevsky, I. Sutskever, and G. E. Hinton, "ImageNet classification with deep convolutional neural networks," Commun. ACM, vol. 60, no. 6, pp. 84–90, May 2017, doi: 10.1145/3065386.

[20] M. Kohler and S. Langer, "On the rate of convergence of fully connected very deep neural network regression estimates," arXiv Prepr. arXiv1908.11133, 2019. Available at: Google Scholar.

[21] L. Gui, R. Xu, Q. Lu, J. Du, and Y. Zhou, "Negative transfer detection in transductive transfer learning," Int. J. Mach. Learn. Cybern., vol. 9, no. 2, pp. 185–197, Feb. 2018, doi: 10.1007/s13042-016-0634-8.

[22] F. Zhuang et al., "A Comprehensive Survey on Transfer Learning," Proc. IEEE, vol. 109, no. 1, pp. 43–76, Jan. 2021, doi: 10.1109/JPROC.2020.3004555.

[23] T. Han, C. Liu, W. Yang, and D. Jiang, "Learning transferable features in deep convolutional neural networks for diagnosing unseen machine conditions," ISA Trans., vol. 93, pp. 341–353, Oct. 2019, doi: 10.1016/j.isatra.2019.03.017.

[24] K. Gupta and N. Chawla, "Analysis of Histopathological Images for Prediction of Breast Cancer Using Traditional Classifiers with Pre-Trained CNN," Procedia Comput. Sci., vol. 167, pp. 878–889, 2020, doi: 10.1016/j.procs.2020.03.427.

[25] A.-A. Nahid, M. A. Mehrabi, and Y. Kong, "Histopathological Breast Cancer Image Classification by Deep Neural Network Techniques Guided by Local Clustering," Biomed Res. Int., vol. 2018, pp. 1–20, 2018, doi: 10.1155/2018/2362108.

[26] C. Zhu, F. Song, Y. Wang, H. Dong, Y. Guo, and J. Liu, "Breast cancer histopathology image classification through assembling multiple compact CNNs," BMC Med. Inform. Decis. Mak., vol. 19, no. 1, p. 198, Dec. 2019, doi: 10.1186/s12911-019-0913-x.

[27] V. Gupta and A. Bhavsar, "Partially-Independent Framework for Breast Cancer Histopathological Image Classification," in 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2019, pp. 1123–1130, doi: 10.1109/CVPRW.2019.00146.

[28] M. Saini and S. Susan, "Deep transfer with minority data augmentation for imbalanced breast cancer dataset," Appl. Soft Comput., vol. 97, p. 106759, Dec. 2020, doi: 10.1016/j.asoc.2020.106759.

[29] Z. Hameed, S. Zahia, B. Garcia-Zapirain, J. Javier Aguirre, and A. María Vanegas, "Breast Cancer Histopathology Image Classification Using an Ensemble of Deep Learning Models," Sensors, vol. 20, no. 16, p. 4373, Aug. 2020, doi: 10.3390/s20164373.

[30] C. Wang et al., "Pulmonary Image Classification Based on Inception-v3 Transfer Learning Model," IEEE Access, vol. 7, pp. 146533–146541, 2019, doi: 10.1109/ACCESS.2019.2946000.

[31] M. Habibzadeh Motlagh, M. Jannesari, Z. Rezaei, M. Totonchi, and H. Baharvand, "Automatic white blood cell classification using pre-trained deep learning models: ResNet and Inception," in Tenth International Conference on Machine Vision (ICMV 2017), 2018, p. 105, doi: 10.1117/12.2311282.

[32] V. Alex, M. Khened, S. Ayyachamy, and G. Krishnamurthi, "Medical image retrieval using Resnet-18 for clinical diagnosis," in Medical Imaging 2019: Imaging Informatics for Healthcare, Research, and Applications, 2019, p. 35, doi: 10.1117/12.2515588.

[33] C. Tan, F. Sun, T. Kong, W. Zhang, C. Yang, and C. Liu, "A Survey on Deep Transfer Learning," 2018, pp. 270–279. Available at: Google Scholar.

[34] A. Sherstinsky, "Fundamentals of Recurrent Neural Network (RNN) and Long Short-Term Memory (LSTM) network," Phys. D Nonlinear Phenom., vol. 404, p. 132306, Mar. 2020, doi: 10.1016/j.physd.2019.132306.

[35] T. A. Mahmoud, A. F. Shehab, and M. A. Elshafey, "Different Long Short-Term Memory Approaches to Enhance Prediction-Based Satellite Telemetry Compression," J. Aerosp. Inf. Syst., vol. 18, no. 2, pp. 50–57, Feb. 2021, doi: 10.2514/1.I010906.

[36] R. C. Staudemeyer and E. R. Morris, "Understanding LSTM--a tutorial into Long Short-Term Memory Recurrent Neural Networks," arXiv Prepr. arXiv1909.09586, 2019. Available at: Google Scholar.

[37] H. Fabelo et al., "Surgical aid visualization system for glioblastoma tumor identification based on deep learning and in-vivo hyperspectral images of human patients," in Medical Imaging 2019: Image-Guided Procedures, Robotic Interventions, and Modeling, 2019, p. 35, doi: 10.1117/12.2512569.

[38] T. Nadira and Z. Rustam, "Classification of cancer data using support vector machines with features selection method based on global artificial bee colony," 2018, p. 020205, doi: 10.1063/1.5064202.

[39] R. Vijayarajeswari, P. Parthasarathy, S. Vivekanandan, and A. A. Basha, "Classification of mammogram for early detection of breast cancer using SVM classifier and Hough transform," Measurement, vol. 146, pp. 800–805, Nov. 2019, doi: 10.1016/j.measurement.2019.05.083.

[40] I. Vidić et al., "Support vector machine for breast cancer classification using diffusion-weighted MRI histogram features: Preliminary study," J. Magn. Reson. Imaging, vol. 47, no. 5, pp. 1205–1216, May 2018, doi: 10.1002/jmri.25873.

[41] J. Cervantes, F. Garcia-Lamont, L. Rodríguez-Mazahua, and A. Lopez, "A comprehensive survey on support vector machine classification: Applications, challenges and trends," Neurocomputing, vol. 408, pp. 189–215, Sep. 2020, doi: 10.1016/j.neucom.2019.10.118.

[42] Y. Tang, S. Oh, J. Xiao, R. M. Summers, and Y. Tang, "CT-realistic data augmentation using generative adversarial network for robust lymph node segmentation," in Medical Imaging 2019: Computer-Aided Diagnosis, 2019, p. 139, doi: 10.1117/12.2512004.

[43] M. Moradi, A. Madani, A. Karargyris, and T. F. Syeda-Mahmood, "Chest x-ray generation and data augmentation for cardiovascular abnormality classification," in Medical Imaging 2018: Image Processing, 2018, p. 57, doi: 10.1117/12.2293971.

[44] D. Abdelhafiz, C. Yang, R. Ammar, and S. Nabavi, "Deep convolutional neural networks for mammography: advances, challenges and applications," BMC Bioinformatics, vol. 20, no. S11, p. 281, Jun. 2019, doi: 10.1186/s12859-019-2823-4.

[45] I. Silva and J. Eugenio Naranjo, "A Systematic Methodology to Evaluate Prediction Models for Driving Style Classification," Sensors, vol. 20, no. 6, p. 1692, Mar. 2020, doi: 10.3390/s20061692.

Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

International Journal of Advances in Intelligent Informatics
ISSN 2442-6571  (print) | 2548-3161 (online)
Organized by Informatics Department - Universitas Ahmad Dahlan, and ASCEE Computer Society
Published by Universitas Ahmad Dahlan
W: http://ijain.org
E: ijain@uad.ac.id (paper handling issues)
    info@ijain.org, andri.pranolo.id@ieee.org (publication issues)

View IJAIN Stats

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0