arrow
Return

Alternative feature selection with user control

delete2024-03-26
delete1
delete
OA
AI
J
Jakob Bach *
K
Klemens Böhm
DOI:10.1007/s41060-024-00527-8delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Feature selection is popular for obtaining small, interpretable, yet highly accurate prediction models. Conventional feature-selection methods typically yield one feature set only, which does not suffice in certain scenarios. For example, users might be interested in finding alternative feature sets with similar prediction quality, offering different explanations of the data. In this article, we introduce alternative feature selection and formalize it as an optimization problem. In particular, we define alternatives via constraints and enable users to control the number and dissimilarity of alternatives. Next, we analyze the complexity of this optimization problem and show N P \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\mathcal{N}\mathcal{P}$$\end{document} -hardness. Further, we discuss how to integrate conventional feature-selection methods as objectives. Finally, we evaluate alternative feature selection in comprehensive experiments with 30 datasets representing binary-classification problems. We observe that alternative feature sets may indeed have high prediction quality, and we analyze factors influencing this outcome.
Keywords:
Feature selection
Alternatives
Constraints
Mixed-integer programming
Explainability
Interpretability
XAI

Journal

I
International Journal of Data Science and Analytics
IF:
2.8
Papers:
1.1K
Citations:
1.3K

Organization

H
Helmholtz Association
Scholars:
13.2W
Papers: 10.7W
Citations: 145
Cited Papers

Cited Papers

errShare
errSave
PMLB: a large benchmark suite for machine learning evaluation and comparison
err2017-12-11
err223
errOAAI
errOlson, Randal S.; La Cava, William; Orzechowski, Patryk; Urbanowicz, Ryan J.; Moore, Jason H.
errShare
errSave
An alternative framework for univariate filter based feature selection for text categorization
err2018-02-01
err30
PREAI
errGuru, D. S.; Suhil, Mahamad; Raju, Lavanya Narayana; Kumar, N. Vinay
errShare
errSave
SBA-15:TiO2 nanocomposites: II. Direct and post-synthesis using acetylacetone
err2017-02-01
err0
PREAI
errAlice A.M.L.F. Jardim; Rebeca Bacani; Norberto S. Gonçalves; Márcia C.A. Fantini; Tereza S. Martins
errShare
errSave
errShare
errSave
Bridge monitoring by fiber optic deformation sensors
err2013-04-10
err0
PREAI
errG Uva; D Raffaele; F Porco; A Fiore; G Porco
errShare
errSave
The effect of noise on requirements comprehension
err2018-05-27
err0
errOAAI
errSimone Romano; Giuseppe Scanniello; Davide Fucci; Natalia Juristo; Burak Turhan
errShare
errSave
A nonsecreting pheochromocytoma presenting as an incidental adrenal mass. Report on a case
err2014-04-04
err0
PREAI
errMassimo Mannelli; C. Pupilli; R. Lanzillotti; L. Ianni; A. Amorosi; G. Credi; C. Pratesi
errShare
errSave
researcher View more