Open Access
Research Article
Optimized deterministic multikernel extreme learning machine for classification of COVID-19 chest Xray images
*Arshi HusainCorresponding authorarshihusaincdac@gmail.comUniversity School of Information, Communication and Technology (USICT) Guru Gobind Singh Indraprastha UniversityDwarka, Delhi, IndiaView full profile → , Virendra P. Vishwakarmavirendravishwa@rediffmail.comUniversity School of Information, Communication and Technology (USICT) Guru Gobind Singh Indraprastha UniversityUniversity School of Information, Communication & Technology Guru Gobind Singh Indraprastha University Sector 16-CDwarka, New Delhi, 110078, IndiaView full profile →
* Corresponding author · click or hover a name for details
- Received:
- 03 Oct 2022
- Accepted:
- 02 Nov 2022
- Published Online:
- 15 May 2023
- Article type:
- Research Article
- Language:
- EN
- Article no.:
- JIOS-1319
- Pages:
- 771–793
Abstract
In this paper, a novel technique has been proposed to exploit the capability of residual network (ResNet) deep learning model to extract the features. It is utilized neither in pretrained form nor as a transfer learning model. ResNet uses shortcut connections to create shortcut blocks in order to skip blocks of convolutional layers (residual blocks). These stacked residual blocks significantly increase training effectiveness and address the degradation issue. For the purpose of classification, a multiple kernel learning based deterministic extreme learning machine (MKD-ELM) which uses a linear combination of different base kernels as target kernel function is designed to classify chest Xray images. Multiple kernels are used here to exploit their non-linear mapping capability on heterogeneous data. MKD-ELM is an enhanced classifier, which does not require iterative training of its parameters. The proposed technique has better feature extraction along with non-iterative training, thus it is having very fast training and very good generalization performance. The kernel and regularization parameters that influence how accurate MKD-ELM is at classifying data, are tuned through experimentation. So, an optimization technique called the genetic algorithm (GA) has been utilized to determine the ideal combination of these parameters for improved performance. The performance of the proposed technique is analysed for COVID-19 detection problem using chest Xray (ChXR) images by changing the training set, types of kernels and coefficients used for combining base kernels. The proposed algorithm achieves a 97.27% recognition rate on first dataset which comprises 5,856 images and 99.06% on the second dataset which consists of 13,808 images. A higher recognition rate is attained for these ChXR image datasets, in respect to modern techniques demonstrating the effectiveness of the proposed algorithm.
Keywords
Subject Classifications
68T10
References
[1] P. Kalane, S. Patil, B. P. Patil, and D. P. Sharma, “Automatic detection of COVID-19 disease using U-Net architecture based fully convolutional network,” Biomed Signal Process Control, Vol. 67 (May 2021), doi: 10.1016/j.bspc.2021.102518.[2] M. Canayaz, “MH-COVIDNet: Diagnosis of COVID-19 using deep neural networks and meta-heuristic-based feature selection on X-ray images,” Biomed Signal Process Control, Vol. 64 (Feb. 2021), doi: 10.1016/j.bspc.2020.102257.[3] M. Otoom, N. Otoum, M. A. Alzubaidi, Y. Etoom, and R. Banihani, “An IoT-based framework for early identification and monitoring of COVID-19 cases,” Biomed Signal Process Control, Vol. 62 (Sep. 2020), doi: 10.1016/j.bspc.2020.102149.[4] Q. Zou, P. Xing, L. Wei, and B. Liu, “Gene2vec: gene subsequence embedding for prediction of mammalian N 6-methyladenosine sites from mRNA” (2019), doi: 10.1261/rna.[5] A. Amirkhani, E. I. Papageorgiou, A. Mohseni, and M. R. Mosavi, “A review of fuzzy cognitive maps in medicine: Taxonomy, methods, and applications,” Computer Methods and Programs in Biomedicine, vol. 142. Elsevier Ireland Ltd, pp. 129–145 (Apr. 01, 2017), doi: 10.1016/j.cmpb.2017.02.021.[6] A. Li et. al. “A Tutorial on Interference Exploitation via Symbol-Level Precoding: Overview, State-of-the-Art and Future Directions.”[7] S. Yang, T. Gao, J. Wang, B. Deng, B. Lansdell, and B. Linares-Barranco, “Efficient Spike-Driven Learning With Dendritic Event-Based Processing,” Front Neurosci, Vol. 15 (Feb. 2021), doi: 10.3389/fnins.2021.601109.[8] W. Rawat and Z. Wang, “Deep convolutional neural networks for image classification: A comprehensive review,” Neural Computation, MIT Press Journals, Vol. 29, No. 9. pp. 2352–2449 (Sep. 01, 2017), doi: 10.1162/NECO_a_00990.[9] Q. v Le, J. Ngiam, A. Coates, A. Lahiri, B. Prochnow, and A. Y. Ng, “On Optimization Methods for Deep Learning” (2011).[10] J. Martens, “Deep learning via Hessian-free optimization” (2010).[11] M. W. Klein, C. Enkrich, M. Wegener, and S. Linden, “Second-harmonic generation from magnetic metamaterials,” Science (1979), Vol. 313, No. 5786, pp. 502–504 (Jul. 2006), doi: 10.1126/science.1129198.[12] L. Kong and J. Cheng, “Classification and detection of COVID-19 X-Ray images based on DenseNet and VGG16 feature fusion,” Biomed Signal Process Control, Vol. 77 (Aug. 2022), doi: 10.1016/j.bspc.2022.103772.[13] A. A. Saraiva et. al. “Classification of images of childhood pneumonia using convolutional neural networks,” in BIOIMAGING 2019 - 6th International Conference on Bioimaging, Proceedings; Part of 12th International Joint Conference on Biomedical Engineering Systems and Technologies, BIOSTEC 2019, pp. 112–119 (2019), doi: 10.5220/0007404301120119.[14] O. Stephen, M. Sain, U. J. Maduh, and D. U. Jeong, “An Efficient Deep Learning Approach to Pneumonia Classification in Healthcare,” J Healthc Eng, Vol. 2019 (2019), doi: 10.1155/2019/4180949.[15] D. S. Kermany et. al. “Identifying Medical Diagnoses and Treatable Diseases by Image-Based Deep Learning,” Cell, Vol. 172, No. 5, pp. 1122-1131.e9 (Feb. 2018), doi: 10.1016/j.cell.2018.02.010.[16] S. Rajaraman, S. Candemir, I. Kim, G. Thoma, and S. Antani, “Visualization and interpretation of convolutional neural network predictions in detecting pneumonia in pediatric chest radiographs,” Applied Sciences (Switzerland), Vol. 8, No. 10 (Sep. 2018), doi: 10.3390/app8101715.[17] P. Sangulagi and A. Kumar, “Detection of Covid-19 from Chest X-Ray Images,” Journal of Scientific Research, Vol. 66, No. 02, pp. 172–178 (2022), doi: 10.37398/jsr.2022.660223.[18] S. Lu, D. Wu, Z. Zhang, and S. H. Wang, “An explainable framework for diagnosis of COVID-19 pneumonia via transfer learning and discriminant correlation analysis,” ACM Transactions on Multimedia Computing, Communications and Applications, Vol. 17, No. 3s (Oct. 2021), doi: 10.1145/3449785.[19] R. Murugan and T. Goel, “E-DiCoNet: Extreme learning machine based classifier for diagnosis of COVID-19 using deep convolutional network,” J Ambient Intell Humaniz Comput, Vol. 12, No. 9, pp. 8887–8898 (Sep. 2021), doi: 10.1007/s12652-020-02688-3.[20] D. Ji, Z. Zhang, Y. Zhao, and Q. Zhao, “Research on Classification of COVID-19 Chest X-Ray Image Modal Feature Fusion Based on Deep Learning,” J Healthc Eng, Vol. 2021 (2021), doi: 10.1155/2021/6799202.[21] M. Umair et. al. “Detection of COVID-19 using transfer learning and grad-cam visualization on indigenously collected X-ray dataset,” Sensors, Vol. 21, No. 17 (Sep. 2021), doi: 10.3390/s21175813.[22] K. He, X. Zhang, S. Ren, and J. Sun, “Deep residual learning for image recognition,” in Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Vol. 2016-December, pp. 770–778 (Dec. 2016), doi: 10.1109/CVPR.2016.90.[23] G. bin Huang, Q. Y. Zhu, and C. K. Siew, “Extreme learning machine: Theory and applications,” Neurocomputing, Vol. 70, No. 1–3, pp. 489–501 (Dec. 2006), doi: 10.1016/j.neucom.2005.12.126.[24] G. bin Huang, H. Zhou, X. Ding, and R. Zhang, “Extreme learning machine for regression and multiclass classification,” IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics, Vol. 42, No. 2, pp. 513–529 (Apr. 2012), doi: 10.1109/TSMCB.2011.2168604.[25] I. Arora, A. Saha, B. Ahuja, and V. P. Vishwakarma, “ELM and KELM based software defect prediction using feature selection techniques,” Journal of Information and Optimization Sciences, Vol. 24, No. 3, pp. 843–858 (2019), doi: 10.1080/09720529.2021.1877409.[26] Rao and Mitra, “Generalized Inverse of Matrices and Its Applications”.[27] A. E. Hoerl and R. W. Kennard, “Ridge Regression: Biased Estimation for Nonorthogonal Problems,” Technometrics, Vol. 12, No. 1, pp. 55–67 (1970), doi: 10.1080/00401706.1970.10488634.[28] C. A. Micchelli and P. Bartlett, “Learning the Kernel Function via Regularization Massimiliano Pontil,” (2005).[29] T. Evgeniou, “Learning Multiple Tasks with Kernel Methods Charles A. Micchelli Massimiliano Pontil,” (2005).[30] B. Ahuja and V. P. Vishwakarma, “Optimised multikernels based extreme learning machine for face recognition Optimised multikernels-based extreme learning machine,” (2018).[31] F. Aiolli and M. Donini, “EasyMKL: A scalable multiple kernel learning algorithm,” Neurocomputing, Vol. 169, pp. 215–224 (Dec. 2015), doi: 10.1016/j.neucom.2014.11.078.[32] Z. Xu, R. Jin, H. Yang, I. King, and M. R. Lyu, “Simple and Efficient Multiple Kernel Learning by Group Lasso,” (2010), [Online]. Available: www.shogun-toolbox.org/[33] S. S. Bucak, R. Jin, and A. K. Jain, “Multiple kernel learning for visual object recognition: A review,” IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 36, No. 7. IEEE Computer Society, pp. 1354–1369 (2014), doi: 10.1109/TPAMI.2013.212.[34] J. Zhuang, I. W. Tsang, S. C. H. Hoi, J. ; Zhuang, and I. W. ; Tsang, “Two-Layer Multiple Kernel Learning Two-Layer Multiple Kernel Learning Citation Citation Two-Layer Multiple Kernel Learning,” (2011), [Online]. Available: https://ink.library.smu.edu.sg/sis_research[35] X. Xu, I. W. Tsang, and D. Xu, “Soft margin multiple kernel learning,” IEEE Trans Neural Netw Learn Syst, Vol. 24, No. 5, pp. 749–761 (2013), doi: 10.1109/TNNLS.2012.2237183.[36] D. E. Goldberg and J. H. Holland, “Genetic Algorithms and Machine Learning _ Enhanced Reader”.[37] W. Chen, M. Panahi, and H. R. Pourghasemi, “Performance evaluation of GIS-based new ensemble data mining techniques of adaptive neuro-fuzzy inference system (ANFIS) with genetic algorithm (GA), differential evolution (DE), and particle swarm optimization (PSO) for landslide spatial modelling,” Catena (Amst), Vol. 157, pp. 310–324 (Oct. 2017), doi: 10.1016/j.catena.2017.05.034.[38] B. Ahuja and V. P. Vishwakarma, “Optimization of regularization coefficient and kernel parameters of KELM in face recognition using genetic algorithm,” Journal of Discrete Mathematical Sciences and Cryptography, Vol. 24, No. 3, pp. 843–858 (2021), doi: 10.1080/09720529.2021.1877409.[39] N. Metawa, M. K. Hassan, and M. Elhoseny, “Genetic algorithm based model for optimizing bank lending decisions,” Expert Syst Appl, Vol. 80, pp. 75–82 (Sep. 2017), doi: 10.1016/j.eswa.2017.03.021.[40] A. Waheed, M. Goyal, D. Gupta, A. Khanna, F. Al-Turjman, and P. R. Pinheiro, “CovidGAN: Data Augmentation Using Auxiliary Classifier GAN for Improved Covid-19 Detection,” IEEE Access, Vol. 8, pp. 91916–91923 (2020), doi: 10.1109/ACCESS.2020.2994762.[41] M. Z. Che Azemin, R. Hassan, M. I. Mohd Tamrin, and M. A. Md Ali, “COVID-19 Deep Learning Prediction Model Using Publicly Available Radiologist-Adjudicated Chest X-Ray Images as Training Data: Preliminary Findings,” Int J Biomed Imaging, Vol. 2020 (2020), doi: 10.1155/2020/8828855.[42] A. Mangal et. al. “CovidAID: COVID-19 Detection Using Chest X-Ray” (Apr. 2020), [Online]. Available: http://arxiv.org/abs/2004.09803[43] S. Wang et. al. “A deep learning algorithm using CT images to screen for Corona virus disease (COVID-19),” Eur Radiol, Vol. 31, pp. 6096–6104 (2021), doi: 10.1007/s00330-021-07715-1/Published.
Views: 93Downloads: 6Citations: 0
