arrow
Return

Binary chemical reaction optimization based feature selection techniques for machine learning classification problems

delete2021-04-01
delete8
PRE
AI
P
P. C. Srinivasa Rao
Q
Quamar Niyaz *
P
Paheding Sidike
V
Vijay Devabhaktuni
DOI:10.1016/j.eswa.2020.114169delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Feature selection is an important pre-processing technique for dimensionality reduction of high-dimensional data in machine learning (ML) field. In this paper, we propose a binary chemical reaction optimization (BCRO) and a hybrid binary chemical reaction optimization-binary particle swarm optimization (HBCRO-BPSO) based feature selection techniques to optimize the number of selected features and improve the classification accuracy. Three objective functions have been used for the proposed feature selection techniques to compare their performances with a BPSO and advanced binary ant colony optimization (ABACO) along with an implemented GA based feature selection approach called as binary genetic algorithm (BGA). Five ML algorithms including K-nearest neighbor (KNN), logistic regression, Naive Bayes, decision tree, and random forest are considered for classification tasks. Experimental results tested on eleven benchmark datasets from UCI ML repository show that the proposed HBCRO-BPSO algorithm improves the average percentage of reduction in features (APRF) and average percentage of improvement in accuracy (APIA) by 5.01% and 3.83%, respectively over the existing BPSO based feature selection method; 4.58% and 3.12% over BGA; and 4.15% and 2.27% over ABACO when used with a KNN classifier.
Keywords:
Machine learning (ML)
Feature selection (FS)
Chemical reaction optimization (CRO)
Particle swarm optimization (PSO)
Genetic algorithm (GA)
Ant colony optimization (ACO)
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Expert Systems with Applications cover
Expert Systems with Applications
IF:
7.5
Papers:
2.9W
Citations:
10.2W

Organization

M
Michigan Technological University
Scholars:
5.0K
Papers: 4.4K
Citations: 6.4K