arrow
返回

Feature selection via binary simultaneous perturbation stochastic approximation.

delete2016-05-01
delete25
delete
OA
AI
V
Vural Aksakallı *
M
Milad Malekipirbazari
DOI:10.1016/j.patrec.2016.03.002delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Feature selection (FS) has become an indispensable task in dealing with today's highly complex pattern recognition problems with massive number of features. In this study, we propose a new wrapper approach for FS based on binary simultaneous perturbation stochastic approximation (BSPSA). This pseudo-gradient descent stochastic algorithm starts with an initial feature vector and moves toward the optimal feature vector via successive iterations. In each iteration, the current feature vector's individual components are perturbed simultaneously by random offsets from a qualified probability distribution. We present computational experiments on datasets with numbers of features ranging from a few dozens to thousands using three widely-used classifiers as wrappers: nearest neighbor, decision tree, and linear support vector machine. We compare our methodology against the full set of features as well as a binary genetic algorithm and sequential FS methods using cross-validated classification error rate and AUC as the performance criteria. Our results indicate that features selected by BSPSA compare favorably to alternative methods in general and BSPSA can yield superior feature sets for datasets with tens of thousands of features by examining an extremely small fraction of the solution space. We are not aware of any other wrapper FS methods that are computationally feasible with good convergence properties for such large datasets. (C) 2016 Elsevier B.V. All rights reserved.
Keyword:
Classification
Feature selection
Stochastic approximation
Genetic algorithm
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Pattern Recognition Letters 封面图
Pattern Recognition Letters
IF:
3.3
论文数:
7.9K
被引数:
1.6W

机构

I
istanbul sehir university
学者数:
99
论文数: 113
被引数: 1
引用论文

引用论文

Dimensionality reduction using genetic algorithms
err2000-07-01
err606
PREAI
errRaymer, ML; Punch, WE; Goodman, ED; Kuhn, LA; Jain, AK
err分享
err收藏
err分享
err收藏
Feature selection based on rough sets and particle swarm optimization
err2007-03-01
err665
errOAAI
errWang, Xiangyang; Yang, Jie; Teng, Xiaolong; Xia, Weijun; Jensen, Richard
err分享
err收藏
err分享
err收藏
err分享
err收藏
学者 查看更多内容