arrow
Return

Efficient cross-validation traversals in feature subset selection

delete2022-12-12
delete2
delete
OA
AI
L
Ludwig Lausser
R
Robin Szekely
F
Florian Schmid
M
Markus Maucher
H
Hans A. Kestler *
DOI:10.1038/s41598-022-25942-4delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Sparse and robust classification models have the potential for revealing common predictive patterns that not only allow for categorizing objects into classes but also for generating mechanistic hypotheses. Identifying a small and informative subset of features is their main ingredient. However, the exponential search space of feature subsets and the heuristic nature of selection algorithms limit the coverage of these analyses, even for low-dimensional datasets. We present methods for reducing the computational complexity of feature selection criteria allowing for higher efficiency and coverage of screenings. We achieve this by reducing the preparation costs of high-dimensional subsets O(nm(2)) to those of one-dimensional ones O(m(2)). Our methods are based on a tight interaction between a parallelizable cross-validation traversal strategy and distance-based classification algorithms and can be used with any product distance or kernel. We evaluate the traversal strategy exemplarily in exhaustive feature subset selection experiments (perfect coverage). Its runtime, fitness landscape, and predictive performance are analyzed on publicly available datasets. Even in low-dimensional settings, we achieve approximately a 15-fold increase in exhaustively generating distance matrices for feature combinations bringing a new level of evaluations into reach.
Keywords:
PANCREATICOBILIARY TUMORS
MULTIPLE TYPES
STABILITY
BIOMARKER
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Scientific Reports cover
Scientific Reports
IF:
3.9
Papers:
27.1W
Citations:
83.5W

Organization

U
ulm university
Scholars:
1.9W
Papers: 1.4W
Citations: 57