arrow
Return

Group feature selection using non-class data

delete2025-04-24
delete0
PRE
AI
李春娜 cover
李春娜 (Chun‐Na Li)
Y
Yuangang Pan
W
Wei-Jie Chen
I
Ivor W. Tsang
邵
邵元海 (Yuan‐Hai Shao) *
DOI:10.1007/s10994-025-06773-6delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Existing embedded feature selection methods barely let non-class data contribute to feature selection. However, in some learning tasks, when non-class data have contribution to classification, they should also have an influence to the selection of useful features. For instance, F-infinity-norm support vector machine is an effective embedded group feature selection method that performs classification simultaneously. In this paper, we find out that it implicitly uses a kind of non-class data formulated as coordinate Universum when implementing group feature selection, and the information contained in this non-class data could be a meaningful group-wise F-infinity-norm penalization. As far as we know, this is the first time that F-infinity-norm penalization is understood from this angle. We prove that useful features can be identified through this non-class data that contribute to classifier construction. In addition, to fully explore the classification information provided by this non-class data, we improve F-infinity-norm support vector machine by deeming the non-class data as a middle class to better classify positive and negative classes. Experiments show that the non-class data in the proposed method help reduce the labelled data in some sense. Furthermore, it improves F-infinity-norm support vector machine in terms of both classification and group feature selection.
Keywords:
Group feature selection
Non-class data
Universum
Support vector machine
F-infinity-norm

Journal

Machine Learning cover
Machine Learning
IF:
2.9
Papers:
2.7K
Citations:
3.4W

Organization

A
ASTAR
Scholars:
1.1K
Papers: 442
Citations: 233
Z
Zhejiang Univ Technol
Scholars:
2.7K
Papers: 978
Citations: 382
Cited Papers

Cited Papers

A Survey on Sparse Learning Models for Feature Selection
err2022-03-01
err97
PREAI
errLi, Xiaoping; Wang, Yadi; Ruiz, Ruben
errShare
errSave
Feature selection with kernelized multi-class support vector machine
err2021-09-01
err80
PREAI
errGuo, Yinan; Zhang, Zirui; Tang, Fengzhen
errShare
errSave
errShare
errSave
Inference with the Universum
err2006-01-01
err0
errOAAI
errJason Weston; Ronan Collobert; Fabian Sinz; Léon Bottou; Vladimir Vapnik
errShare
errSave
Early-life trauma endophenotypes and brain circuit-gene expression relationships in functional neurological (conversion) disorder
err2020-02-12
err63
errOAAI
errDiez, Ibai; Larson, Anna G.; Nakhate, Vihang; Dunn, Erin C.; Fricchione, Gregory L.; Nicholson, Timothy R.; Sepulcre, Jorge; Perez, David L.
errShare
errSave
Gene selection for cancer classification using support vector machines
err2002-01-01
err7.5K
errOAAI
errGuyon, I; Weston, J; Barnhill, S; Vapnik, V
errShare
errSave
Temporally Constrained Sparse Group Spatial Patterns for Motor Imagery BCI
err2019-09-01
err260
errOAAI
errZhang, Yu; Nam, Chang S.; Zhou, Guoxu; Jin, Jing; Wang, Xingyu; Cichocki, Andrzej
errShare
errSave
Discriminative sparse subspace learning with manifold regularization
err2024-09-01
err2
PREAI
errFeng, Wenyi; Wang, Zhe; Cao, Xiqing; Cai, Bin; Guo, Wei; Ding, Weichao
errShare
errSave
The Elements of Statistical Learning
err2009-01-01
err0
PREAI
errTrevor Hastie; Robert Tibshirani; Jerome Friedman
errShare
errSave
researcher View more