A Novel Image Feature Extraction Based Machine Learning approach for Disease Detection from Chest X-Ray Images
Abstract
The limitation of feature selection is the biggest challenge for machine learning classifiers in disease classification. This research proposes a novel feature extraction method to extract representative features from medical images, combining extracted features with original image pixel features. Additionally, we propose a new method that uses data values from Andrews's curve function to transform chest x-ray images into spectrograms. The spectrogram images are believed to aid in distinguishing near-similar medical images, such as COVID and pneumonia. The study aims to build an efficient machine learning system that applies the proposed feature extraction method and utilizes spectrogram images for distinguishing near-similar medical images. For experimental analysis, we have used the award winning Kaggle Chest Radiography image dataset. The test results show that among all machine learning classifiers, the logistic regression classifier could correctly distinguish COVID and pneumonia images with a 97.18% test accuracy, a 98.34% detection rate, a 97.8% precision rate, and an AUC value of 0.99 on the test dataset. The machine learning model has learned to distinguish between medical images that appear similar using features found through the proposed feature extraction and spectrogram images. The results also proved that the proposed approach using XGBoost has outperformed state-of-the-art models in recent research studies when (i) binary classification is performed using COVID-19 and Normal Chest x-ray images and (ii) multiclass classification is performed using Normal, COVID and Pneumonia Chest x-ray images.
Downloads
References
Nikolaou, V., Massaro, S., Fakhimi, M. et al., “COVID-19 diagnosis from chest x-rays: developing a simple, fast, and accurate neural network”, Health Inf Sci Syst, Vol 9, No.36 pp. 1-11, 2021.
Goel, Kanika et al., “The effect of machine learning explanations on user trust for automated diagnosis of COVID-19”, Computers in biology and medicine, Vol. 146, pp. 1-12, 2022.
H. Panwar, P.K. Gupta, M.K. Siddiqui, R. Morales-Menendez, V. Singh, “Application of deep learning for fast detection of COVID-19 in X-rays using nCOVnet”, Chaos Solitons Fractals, Vol. 138, pp. 1-8, 2020.
Al-Zyoud W, Erekat D, Saraiji R., “COVID-19 chest X-ray image analysis by threshold-based segmentation”, Heliyon, Vol. 10, No. 3, pp. 1-12, 2023.
Abdullah M, Abrha FB, Kedir B, Tamirat Tagesse T., “A Hybrid Deep Learning CNN model for COVID-19 detection from chest X-rays”. Heliyon, Vol. 10, No. 3, pp. 1-13, 2024.
Ismael, A.M.; Şengür, A. “Deep learning approaches for COVID-19 detection based on chest X-ray images”, Expert Syst. Appl, Vol. 164, pp. 1-11, 2020.
M. Toğaçar, B. Ergen, Z. Cömert, “COVID-19 detection using deep learning models to exploit Social Mimic Optimization and structured chest X-ray images using fuzzy color and stacking approaches”, Computers in Biology and Medicine, Vol. 121, pp.1-12, 2020.
Abbas, A., Abdelsamea, M.M. and Gaber, M.M, “ Classification of COVID-19 in chest X-ray images using DeTraC deep convolutional neural network”, Applied Intelligence, Vol. 51, pp. 854–864, 2021.
Ahsan MM, Gupta KD, Islam MM, Sen S, Rahman ML, Shakhawat Hossain M, “ COVID-19 Symptoms Detection Based on NasNetMobile with Explainable AI Using Various Imaging Modalities”, Machine Learning and Knowledge Extraction, Vol. 2, No. 4, pp. 490-504, 2020.
Hall, L.O.; Paul, R.; Goldgof, D.B.; Goldgof, G.M. “Finding Covid-19 from Chest X-rays Using Deep Learning on a Small Dataset”, arXiv 2020, arXiv: 2004.02060. (accessed on 15 June 2021).
Heidari, A., Jafari Navimipour, N., Unal, M. et al., “Machine learning applications for COVID-19 outbreak management”, Neural Computing & Applications, Vol. 34, pp. 15313–15348, 2022.
Dogan, O., Tiwari, S., Jabbar, M.A. et al.,” A systematic review on AI/ML approaches against COVID-19 outbreak”, Complex Intelligent. Systems Vol. 7, pp.2655–2678, 2021.
Ajagbe, S.A., Adigun, M.O, “Deep learning techniques for detection and prediction of pandemic diseases: a systematic literature review”, Multimed Tools Appl , Vol. 83, pp. 5893–5927, 2024
Afshin Shoeibi et al., “Automated detection and forecasting of COVID-19 using deep learning techniques: A review”, Neurocomputing, Volume 577, 2024.
Sharma, S., Guleria, K, “A systematic literature review on deep learning approaches for pneumonia detection using chest X-ray images”, Multimed Tools Appl, Vol. 83, pp. 24101–24151, 2024.
Koyyada, S.P., Singh, T.P, ”A Systematic Survey of Automatic Detection of Lung Diseases from Chest X-Ray Images: COVID-19, Pneumonia, and Tuberculosis”, SN Computer Science, Springer, Vol. 5, 2024.
Mallick, D., Singh, A., Ng, E.YK. et al.,” Classifying chest x-rays for COVID-19 through transfer learning: a systematic review”, Multimedia Tools and Applications, pp. 1-60, 2024. https://doi.org/10.1007/s11042-024-18924-3
Samira Sajed, Amir Sanati, Jorge Esparteiro Garcia, Habib Rostami, Ahmad Keshavarz, Andreia Teixeira, “The effectiveness of deep learning vs. traditional methods for lung disease diagnosis using chest X-ray images: A systematic review”, Applied Soft Computing, Vol. 147, 2023.
Agrawal, T., Choudhary, P, “Segmentation and classification on chest radiography: a systematic survey”, The Visual Computer, Vol. 39, pp. 875–913, 2023.
Koul, A., Bawa, R.K. & Kumar, Y, ‘Artificial Intelligence Techniques to Predict the Airway Disorders Illness: A Systematic Review”, Arch Computat Methods Eng, Vol. 30, pp. 831–864 2023.
Rasheed, J., Hameed, A.A., Djeddi, C. et al., “A machine learning-based framework for diagnosis of COVID-19 from chest X-ray images”, Interdisciplinary Sciences: Computational Life Sciences, Vol. 13, pp. 103–117, 2021.
Chow, L. S. et al. Quantitative and qualitative analysis of 18 deep convolutional neural network (CNN) models with transfer learning to diagnose COVID-19 on chest X-ray (CXR) images. SN Comput. Sci. 4(2), 141 (2023).
El Houby, E.M.F. COVID‑19 detection from chest X-ray images using transfer learning. Sci Rep 14, 11639 (2024).
COVID-19 Radiography Database. https://www.kaggle.com/tawsifurrahman/covid19-radiography-database. Accessed 3 May 2021.
Minaee, S. et al. Deep-COVID: Predicting COVID-19 from chest X-ray images using deep transfer learning. Med. Image Anal. 65, 101794 (2020).
Kanwal K, Asif M, Khalid SG, Liu H, Qurashi AG, Abdullah S. Current Diagnostic Techniques for Pneumonia: A Scoping Review. Sensors (Basel). 2024 Jul 1;24(13):4291.
Nillmani, Jain PK, Sharma N, Kalra MK, Viskovic K, Saba L, Suri JS. Four Types of Multiclass Frameworks for Pneumonia Classification and Its Validation in X-ray Scans Using Seven Types of Deep Learning Artificial Intelligence Models. Diagnostics (Basel). 2022 Mar 7;12(3):652.
K. Sanchez, C. Hinojosa, H. Arguello, D. Kouamé, O. Meyrignac and A. Basarab, "CX-DaGAN: Domain Adaptation for Pneumonia Diagnosis on a Small Chest X-Ray Dataset," in IEEE Transactions on Medical Imaging, vol. 41, no. 11, pp. 3278-3288, Nov. 2022
W. Khan, N. Zaki and L. Ali, "Intelligent Pneumonia Identification From Chest X-Rays: A Systematic Literature Review," in IEEE Access, vol. 9, pp. 51747-51771, 2021
Y. Liu, W. Xing, M. Lin, Y. Liu and T. W. S. Chow, "A New Classification Method for Diagnosing COVID-19 Pneumonia via Joint Parallel Deformable MLP Modules and Bi-LSTM With Multi-Source Generated Data of CXR Images," in IEEE Transactions on Consumer Electronics, vol. 70, no. 1, pp. 2794-2805, Feb. 2024
Y. Oh, S. Park and J. C. Ye, "Deep learning COVID-19 features on CXR using limited training data sets", IEEE Trans. Med. Imag., vol. 39, no. 8, pp. 2688-2700, Aug. 2020.
O. Ronneberger, P. Fischer, and T. Brox, “U-net: Convolutional networks for biomedical image segmentation,” in Proc. Int. Conf. Med. Image Comput. Comput.-Assist. Intervent. (MICCAI), in Lecture Notes in Computer Science, vol. 9351. Cham, Switzerland: Springer, 2015, pp. 234–241.
S. Jegou, M. Drozdzal, D. Vazquez, A. Romero, and Y. Bengio, “The one hundred layers tiramisu: Fully convolutional DenseNets for semantic segmentation,” in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. Workshops (CVPRW), Jul. 2017, pp. 11–19.
D. Lobo Torres et al., “Applying fully convolutional architectures for semantic segmentation of a single tree species in urban environment on high resolution UAV optical imagery,” Sensors, vol. 20, no. 2, p. 563, 2020.
L. Wang and A. Wong, “COVID-net: A tailored deep convolutional neural network design for detection of COVID-19 cases from chest X-ray images,” 2020, arXiv:2003.09871. [Online]. Available: http://arxiv.org/abs/2003.09871.
Copyright (c) 2024 Sravan kiran Vangipuram, Rajesh Appusamy
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution-ShareAlikel 4.0 International (CC BY-SA 4.0) that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).