arrow
Return

A scalable saliency-based feature selection method with instance-level information

delete2020-03-01
delete7
delete
OA
AI
B
Brais Cancela *
V
Verónica Bolón‐Canedo
A
Amparo Alonso‐Betanzos
J
João Gama
DOI:10.1016/j.knosys.2019.105326delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Classic feature selection techniques remove irrelevant or redundant features to achieve a subset of relevant features in compact models that are easier to interpret and so improve knowledge extraction. Most such techniques operate on the whole dataset, but are unable to provide the user with useful information when only instance-level information is required; in other words, classic feature selection algorithms do not identify the most relevant information in a sample. We have developed a novel feature selection method, called saliency-based feature selection (SFS), based on deep-learning saliency techniques. Our algorithm works under any architecture that is trained by using gradient descent techniques (Neural Networks, SVMs, ...), and can be used for classification or regression problems. Experimental results show our algorithm is robust, as it allows to transfer the feature ranking result between different architectures, achieving remarkable results. The versatility of our algorithm has been also demonstrated, as it can work either in big data environments as well as with small datasets. (C) 2019 Elsevier B.V. All rights reserved.
Keywords:
Feature selection
Deep learning
Saliency
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

K
Knowledge-Based Systems
IF:
7.6
Papers:
1.3W
Citations:
4.5W

Organization

U
Universidade da Coruna
Scholars:
6.6K
Papers: 5.7K
Citations: 11
U
Universidade do Porto
Scholars:
3.0W
Papers: 2.9W
Citations: 34
Cited Papers

Cited Papers

Pediatric Optic Neuritis
err2012-01-01
err0
PREAI
errMays A. El-Dairi; Fatema Ghasia; M. Tariq Bhatti
errShare
errSave
errShare
errSave
Gradient-based learning applied to document recognition
err1998-01-01
err3.8W
PREAI
errLecun, Y; Bottou, L; Bengio, Y; Haffner, P
errShare
errSave
Regularization Paths for Generalized Linear Models via Coordinate Descent
err2010-01-01
err1.3W
errOAAI
errFriedman, Jerome; Hastie, Trevor; Tibshirani, Rob
errShare
errSave
Gene selection for cancer classification using support vector machines
err2002-01-01
err7.5K
errOAAI
errGuyon, I; Weston, J; Barnhill, S; Vapnik, V
errShare
errSave
errShare
errSave
An intelligent system for spam detection and identification of the most relevant features based on evolutionary Random Weight Networks
err2019-08-01
err176
PREAI
errFaris, Hossam; Al-Zoubi, Ala M.; Heidari, Ali Asghar; Aljarah, Ibrahim; Mafarja, Majdi; Hassonah, Mohammad A.; Fujita, Hamido
errShare
errSave
researcher View more