arrow
Return

Scalable variable selection for two-view learning tasks with projection operators

delete2023-12-22
delete0
delete
OA
AI
S
Sándor Szedmák *
R
Riikka Huusari
T
Tat Hong Duong Le
J
Juho Rousu
DOI:10.1007/s10994-023-06433-7delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In this paper we propose a novel variable selection method for two-view settings, or for vector-valued supervised learning problems. Our framework is able to handle extremely large scale selection tasks, where number of data samples could be even millions. In a nutshell, our method performs variable selection by iteratively selecting variables that are highly correlated with the output variables, but which are not correlated with the previously chosen variables. To measure the correlation, our method uses the concept of projection operators and their algebra. With the projection operators the relationship, correlation, between sets of input and output variables can also be expressed by kernel functions, thus nonlinear correlation models can be exploited as well. We experimentally validate our approach, showing on both synthetic and real data its scalability and the relevance of the selected features.
Keywords:
Supervised variable selection
Vector-valued learning
Projection-valued measure
Reproducing kernel Hilbert space

Journal

Machine Learning cover
Machine Learning
IF:
2.9
Papers:
2.6K
Citations:
3.4W

Organization

A
Aalto University
Scholars:
1.6W
Papers: 1.5W
Citations: 2.1W