Identify Best Learning Method for Heart Diseases Prediction Under impact of Different Datasets Characteristics
DOI:
https://doi.org/10.31642/JoKMC/2018/100104Keywords:
Cardiovascular diseases, Deep learning, Data sparsity, Machine learning, Random ForestAbstract
This paper introduces an experimental study of the heart disease datasets characteristics impact on the performance of classification algorithms in the aim of identifying the best algorithm for each dataset under its characteristics. The performance of five machine learning algorithms (logistic regression (LR), K-Nearest Neighbor (KNN), Decision tree (DT), Random Forest (RF), and support vector machine (SVM)), single layer neural network (ANN), and deep neural network (DNN), has been evaluated using five heart disease datasets under four data complexity measurement: number of samples (dataset size), number of features (dimension of dataset), Data sparsity measures, and correlation of features. All datasets have been processed and normalized then the mutual information-based feature selection method was used to solve the overfitting problem. The results show that in general, the machine learning especially the Random Forest algorithm achieves high classification accuracy than deep learning network. In other hand, the high sparsity and less mutual information of dataset has large impact on degradation of the performance of classification algorithms than other characteristics of data.
Downloads
References
R. G. Nadakinamani et al., “Clinical Data Analysis for Prediction of Cardiovascular Disease Using Machine Learning Techniques,” Comput. Intell. Neurosci., vol. 2022, 2022. DOI: https://doi.org/10.1155/2022/2973324
D. Oreski, S. Oreski, and B. Klicek, “Effects of dataset characteristics on the performance of feature selection techniques,” Appl. Soft Comput., vol. 52, pp. 109–119, 2017. DOI: https://doi.org/10.1016/j.asoc.2016.12.023
A. Gacek, “An introduction to ECG signal processing and analysis,” in ECG Signal Processing, Classification and Interpretation, Springer, 2012, pp. 21–46. DOI: https://doi.org/10.1007/978-0-85729-868-3_2
K. H. Boon, M. Khalil-Hani, and M. B. Malarvili, “Paroxysmal atrial fibrillation prediction based on HRV analysis and non-dominated sorting genetic algorithm III,” Comput. Methods Programs Biomed., vol. 153, pp. 171–184, 2018. DOI: https://doi.org/10.1016/j.cmpb.2017.10.012
F. Charte, A. Rivera, M. J. del Jesus, and F. Herrera, “On the impact of dataset complexity and sampling strategy in multilabel classifiers performance,” in International conference on hybrid artificial intelligence systems, 2016, pp. 500–511. DOI: https://doi.org/10.1007/978-3-319-32034-2_42
J. Ribeiro, R. Silva, L. Cardoso, and R. Alves, “Does Dataset Complexity Matters for Model Explainers?,” in 2021 IEEE International Conference on Big Data (Big Data), 2021, pp. 5257–5265. DOI: https://doi.org/10.1109/BigData52589.2021.9671630
F. Branchaud-Charron, A. Achkar, and P.-M. Jodoin, “Spectral metric for dataset complexity assessment,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2019, pp. 3215–3224. DOI: https://doi.org/10.1109/CVPR.2019.00333
N. Anwar, G. Jones, and S. Ganesh, “Measurement of data complexity for classification problems with unbalanced data,” Stat. Anal. Data Min. ASA Data Sci. J., vol. 7, no. 3, pp. 194–211, 2014. DOI: https://doi.org/10.1002/sam.11228
Y. Zhang, S. Wei, C. Di Maria, and C. Liu, “Using Lempel–Ziv complexity to assess ECG signal quality,” J. Med. Biol. Eng., vol. 36, no. 5, pp. 625–634, 2016. DOI: https://doi.org/10.1007/s40846-016-0165-5
J. Luengo, A. Fernández, S. García, and F. Herrera,“Addressing data complexity for imbalanced data sets: analysis of SMOTE-based oversampling and evolutionary undersampling,” Soft Comput., vol. 15, no. 10, pp. 1909–1936, 2011. DOI: https://doi.org/10.1007/s00500-010-0625-8
J. P. Li, A. U. Haq, S. U. Din, J. Khan, A. Khan, and A. Saboor, “Heart disease identification method using machine learning classification in e-healthcare,” IEEE Access, vol. 8, pp. 107562–107582, 2020. DOI: https://doi.org/10.1109/ACCESS.2020.3001149
P. Ghosh et al., “Efficient prediction of cardiovascular disease using machine learning algorithms with relief and LASSO feature selection techniques,” IEEE Access, vol. 9, pp. 19304–19326, 2021. DOI: https://doi.org/10.1109/ACCESS.2021.3053759
J. Brownlee, “Information gain and mutual information for machine learning,” Preuzeto, vol. 18, p. 2020, 2019.
S. Marsland, Machine learning: an algorithmic perspective. Chapman and Hall/CRC, 2011.
B. Mahesh, “Machine learning algorithms-a review,” Int. J. Sci. Res. (IJSR).[Internet], vol. 9, pp. 381–386, 2020.
J. Alzubi, A. Nayyar, and A. Kumar, “Machine learning from theory to algorithms: an overview,” in Journal of physics: conference series, 2018, vol. 1142, no. 1, p. 12012. DOI: https://doi.org/10.1088/1742-6596/1142/1/012012
Y. LeCun, Y. Bengio, and G. Hinton, “Deep learning,” Nature, vol. 521, no. 7553, pp. 436–444, 2015. DOI: https://doi.org/10.1038/nature14539
C. M. Van der Walt, “Data measures that characterise classification problems.” University of Pretoria, 2008.
Y.-H. Chen and S.-N. Yu, “Selection of effective features for ECG beat recognition based on nonlinear correlations,” Artif. Intell. Med., vol. 54, no. 1, pp. 43–52, 2012. DOI: https://doi.org/10.1016/j.artmed.2011.09.004
M. S. Bin Sinal and E. Kamioka, “An Efficient Arrhythmia Detection Using Autocorrelation and Statistical Approach,” J. Comput. Commun., vol. 6, no. 10, pp. 63–81, 2018. DOI: https://doi.org/10.4236/jcc.2018.610006
S. Goswami, C. A. Murthy, and A. K. Das, “Sparsity measure of a network graph: Gini index,” Inf. Sci. (Ny)., vol. 462, pp. 16–39, 2018. DOI: https://doi.org/10.1016/j.ins.2018.05.044
R. Shwartz-Ziv and A. Armon, “Tabular data: Deep learning is not all you need,” Inf. Fusion, vol. 81, pp. 84–90, 2022. DOI: https://doi.org/10.1016/j.inffus.2021.11.011
Downloads
Published
How to Cite
Issue
Section
Categories
License
Copyright (c) 2023 Zahraa chaffat Oleiwi, Ebtesam N. AlShemmary, Salam Al-augby
This work is licensed under a Creative Commons Attribution 4.0 International License.
which allows users to copy, create extracts, abstracts, and new works from the Article, alter and revise the Article, and make commercial use of the Article (including reuse and/or resale of the Article by commercial entities), provided the user gives appropriate credit (with a link to the formal publication through the relevant DOI), provides a link to the license, indicates if changes were made and the licensor is not represented as endorsing the use made of the work.
