arrow
Return

A scalable saliency-based feature selection method with instance-level information

delete2020-03-01
delete7
delete
OA
AI
B
Brais Cancela *
V
Verónica Bolón‐Canedo
A
Amparo Alonso‐Betanzos
J
João Gama
DOI:10.1016/j.knosys.2019.105326delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Classic feature selection techniques remove irrelevant or redundant features to achieve a subset of relevant features in compact models that are easier to interpret and so improve knowledge extraction. Most such techniques operate on the whole dataset, but are unable to provide the user with useful information when only instance-level information is required; in other words, classic feature selection algorithms do not identify the most relevant information in a sample. We have developed a novel feature selection method, called saliency-based feature selection (SFS), based on deep-learning saliency techniques. Our algorithm works under any architecture that is trained by using gradient descent techniques (Neural Networks, SVMs, ...), and can be used for classification or regression problems. Experimental results show our algorithm is robust, as it allows to transfer the feature ranking result between different architectures, achieving remarkable results. The versatility of our algorithm has been also demonstrated, as it can work either in big data environments as well as with small datasets. (C) 2019 Elsevier B.V. All rights reserved.
Keywords:
Feature selection
Deep learning
Saliency
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

K
Knowledge-Based Systems
IF:
7.6
Papers:
1.2W
Citations:
4.5W

Organization

U
Universidade da Coruna
Scholars:
6.6K
Papers: 5.7K
Citations: 11
U
Universidade do Porto
Scholars:
3.0W
Papers: 2.9W
Citations: 34