Data Reduction Techniques: A Comparative Study

Authors

  • Ahmed Reyd AlKarawi Department of Computer Science, Faculty of CS and Mathematics, University of Kufa, ALNajaf, Iraq
  • Kadhim B. S. AlJanabi Department of Computer Science, Faculty of CS and Mathematics, University of Kufa, ALNajaf, Iraq

DOI:

https://doi.org/10.31642/JoKMC/2018/090201

Keywords:

Data Mining, Data Preprocessing, Data Reduction, Dimensionality Reduction

Abstract

Data preprocessing in general and data reduction in specific represent the main steps in data mining techniques and algorithms since data in real world due to its vastness, the analysis will take a long time to complete .Almost all mining techniques including classification, clustering, association and others have high time and space complexities due to the huge amount of data and the algorithm behavior itself. That is the reason why data reduction represent an important phase in Knowledge Discovery in Databases (KDD) process. Many researchers introduced important solutions in this field. The study in this paper represents a comparative study for about 22 research papers in data reduction fields that covers different data reduction techniques such as dimensionality reduction, numerisoty reduction, sampling, clustering data cube aggregation and other techniques. From the conducted study, it can be concluded that the appropriate technique that can be used in data reduction is highly dependent on the data type, the dataset size, the application goal, the availability of noise and outliers and the compromise between the reduced data and the knowledge required from the analysis

Downloads

Download data is not yet available.

References

Agarwal,Shivam."Datamining:Dataminingconceptsandtechniques."2013internationalconferenceonmachineintelligenceandresearchadvancement.IEEE,2013.

Padhy,Neelamadhab,DrMishra,andRasmitaPanigrahi."The survey of data mining applications and featurescope." arXivpreprintarXiv:1211.5723(2012).

Hartama, Dedy, Agus Perdana Windarto, and Anjar Wanto."The Application of Data Mining in Determining PatternsofInterestofHighSchoolGraduates."JournalofPhysics:Conference Series. Vol. 1339. No. 1. IOP Publishing,2019.

Gürbüz, Feyza, Lale Özbakir, and Hüseyin Yapici. "Datamining and preprocessing application on componentreportsofanairlinecompanyinTurkey."ExpertSystemswith Applications38.6(2011):6618-6626.García,Salvador,etal."Bigdatapreprocessing:methodsand prospects."BigDataAnalytics 1.1(2016):1-22.

Cano,JoséRamón,FranciscoHerrera,andManuelLozano."Usingevolutionaryalgorithmsasinstanceselectionfordata reductioninKDD:Anexperimentalstudy."IEEEtransactionsonevolutionaryomputation7.6(2003):561-575.

Singhal, Swasti, and Monika Jena. "A study on WEKAtool for data preprocessing, classification andclustering. "InternationalJournalofInnovativetechnologyandexploringengineering(IJItee)2.6(2013):250-253

Bania, R. K. "Survey on feature selection for datareduction."International Journal of Computer Applications 94.18(2014).

Benjelloun, Fatima-Zahra, Ayoub Ait Lahcen, and SamirBelfkih. "An overview of big data opportunities, applicationsandtools." 2015IntelligentSystemsandComputer Vision(ISCV)(2015):1-6.

Chen,CLPhilip,andChun-YangZhang."Data-intensiveapplications, challenges, techniques and technologies:A survey on Big Data." Information sciences 275(2014):314-347.

Bokaba,Tebogo,WesleyDoorsamy,andBabuSenaPaul."Comparative study of machine learning classifiers formodellingroad traffic accidents."AppliedSciences12.2 (2022):828.

https://www.linkedin.com/pulse/what-dimensionality-reduction-algorithm-ml-how-we-bhattacharjee

https://clauswilke.com/dataviz/histograms-density-plots.html.

https://www.javatpoint.com/data-warehouse-what-is-data-cube.

El-Hasnony, Ibrahim M., Hazem M. El Bakry, and AhmedA.Saleh. "Comparative study among datareduction techniques over classificationaccuracy." International Journal of ComputerApplications122.2(2015).

Georgescu, Ramona, et al. "Comparison of data reductiontechniques based on the performance of SVM-typeclassifiers. " 2010 IEEE Aerospace Conference. IEEE,2010.

Alamro,Reham,andAbdouYoussef."Impactofdatareductiontechniquesonclassification."2018InternationalConferenceonComputationalScienceandComputationalIntelligence(CSCI).IEEE,2018

Downloads

Published

2022-08-30

How to Cite

AlKarawi, A., & AlJanabi, K. (2022). Data Reduction Techniques: A Comparative Study. Journal of Kufa for Mathematics and Computer, 9(2), 1–17. https://doi.org/10.31642/JoKMC/2018/090201