arrow
返回

Towards high dimensional instance selection: An evolutionary approach

delete2014-05-01
delete23
PRE
AI
C
Chih‐Fong Tsai *
Z
Zong-Yao Chen
DOI:10.1016/j.dss.2014.01.012delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Data reduction is an important data pre-processing step in the KDD process. It can be approached by the application of some instance selection algorithms to filter out unrepresentative or noisy data from a given (training) dataset. However, the performance of instance selection over very high dimensional data has not yet been fully examined. In this paper, we introduce a novel efficient genetic algorithm (EGA), which fits biological evolution into the evolutionary process. In other words, after long-term evolution, individuals find the most efficient way to allocate resources and evolve. The experimental study is based on four very high dimensional datasets ranging from 200 to 18,236 dimensions. In addition, four state-of-the-art algorithms including IB3, DROP3, ICF, and GA are compared with EGA. The experimental results show that EGA allows the k-NN and SVM classifiers to provide the most comparable classification performance with the baseline classifiers without instance selection. Particularly, EGA outperforms the four algorithms in terms of average classification accuracy. Moreover, EGA can produce the largest reduction rates (the same as GA) and it requires relatively less computational time than the other four algorithms. (C) 2014 Elsevier B.V. All rights reserved.
Keyword:
Data reduction
Instance selection
Data mining
Machine learning
Genetic algorithms
High dimensional data

期刊

Decision Support Systems 封面图
Decision Support Systems
IF:
6.8
论文数:
3.8K
被引数:
1.5W

机构

N
National Central University
学者数:
1.0W
论文数: 8.6K
被引数: 6.4K
引用论文

引用论文

Partial insurance, information and consumption dynamics
err2002-08-17
err0
errOAAI
errRichard Blundell; Luigi Pistaferri; Ian Preston
err分享
err收藏
err分享
err收藏
Subcutaneous sweat pore estimation from optical coherence tomography
err2021-08-09
err0
errOAAI
errBaojin Ding; Haixia Wang; Peng Chen; Yilong Zhang; Ronghua Liang; Yipeng Liu
err分享
err收藏
学者 查看更多内容