arrow
Return

An adaptive heuristic for feature selection based on complementarity

delete2018-06-19
delete26
delete
OA
AI
S
Sumanta Singha *
P
Prakash P. Shenoy
DOI:10.1007/s10994-018-5728-ydelete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Feature selection is a dimensionality reduction technique that helps to improve data visualization, simplify learning, and enhance the efficiency of learning algorithms. The existing redundancy-based approach, which relies on relevance and redundancy criteria, does not account for feature complementarity. Complementarity implies information synergy, in which additional class information becomes available due to feature interaction. We propose a novel filter-based approach to feature selection that explicitly characterizes and uses feature complementarity in the search process. Using theories from multi-objective optimization, the proposed heuristic penalizes redundancy and rewards complementarity, thus improving over the redundancy-based approach that penalizes all feature dependencies. Our proposed heuristic uses an adaptive cost function that uses redundancy-complementarity ratio to automatically update the trade-off rule between relevance, redundancy, and complementarity. We show that this adaptive approach outperforms many existing feature selection methods using benchmark datasets.
Keywords:
Dimensionality reduction
Feature selection
Classification
Feature complementarity
Adaptive heuristic
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Machine Learning cover
Machine Learning
IF:
2.9
Papers:
2.6K
Citations:
3.4W

Organization

I
indian school of business (isb)
Scholars:
257
Papers: 311
Citations: 0
U
University of Kansas
Scholars:
1.9W
Papers: 1.7W
Citations: 8.1K