arrow
返回

On feature selection protocols for very low-sample-size data

delete2018-09-01
delete32
delete
OA
AI
L
Ludmila I. Kuncheva
J
Juan J. Rodríguez *
DOI:10.1016/j.patcog.2018.03.012delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
High-dimensional data with very few instances are typical in many application domains. Selecting a highly discriminative subset of the original features is often the main interest of the end user. The widely used feature selection protocol for such type of data consists of two steps. First, features are selected from the data (possibly through cross-validation), and, second, a cross-validation protocol is applied to test a classifier using the selected features. The selected feature set and the testing accuracy are then returned to the user. For the lack of a better option, the same low-sample-size dataset is used in both steps. Questioning the validity of this protocol, we carried out an experiment using 24 high-dimensional datasets, three feature selection methods and five classifier models. We found that the accuracy returned by the above protocol is heavily biased, and therefore propose an alternative protocol which avoids the contamination by including both steps in a single cross-validation loop. Statistical tests verify that the classification accuracy returned by the proper protocol is significantly closer to the true accuracy (estimated from an independent testing set) compared to that returned by the currently favoured protocol. (C) 2018 Elsevier Ltd. All rights reserved.
Keyword:
Feature selection
Wide datasets
Experimental protocol
Training/testing
Cross-validation
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Pattern Recognition 封面图
Pattern Recognition
IF:
7.6
论文数:
1.3W
被引数:
4.5W

机构

Universidad de Burgos 封面图
Universidad de Burgos
学者数:
2.4K
论文数: 2.2K
被引数: 1.9K
B
Bangor University
学者数:
4.5K
论文数: 4.6K
被引数: 7.6K
引用论文

引用论文

The Peeking Effect in Supervised Feature Selection on Diffusion Tensor Imaging Data
err2013-07-18
err21
errOAAI
errDiciotti, S.; Ciulli, S.; Mascalchi, M.; Giannelli, M.; Toschi, N.
err分享
err收藏
Improved multiclass feature selection via list combination
err2017-12-01
err9
errOAAI
errIzetta, Javier; Verdes, Pablo F.; Granitto, Pablo M.
err分享
err收藏
Self-taught dimensionality reduction on the high-dimensional small-sized data
err2013-01-01
err154
PREAI
errZhu, Xiaofeng; Huang, Zi; Yang, Yang; Shen, Heng Tao; Xu, Changsheng; Luo, Jiebo
err分享
err收藏
The effect of ageing on the response to frusemide in normal subjects
err1984-01-01
err0
PREAI
errA. Y. Chaudhry; R. F. Bing; C. M. Castleden; J. D. Swales; C. J. Napier
err分享
err收藏
The electroneutrality approximation in electrochemistry电化学中的电中性近似
err2011-02-22
err0
PREAI
errEdmund J. F. Dickinson; Juan G. Limon-Petersen; Richard G. Compton
err分享
err收藏
err分享
err收藏
Fast wrapper feature subset selection in high-dimensional datasets by means of filter re-ranking
err2012-02-01
err123
PREAI
errBermejo, Pablo; de la Ossa, Luis; Gamez, Jose A.; Puerta, Jose M.
err分享
err收藏
学者 查看更多内容