arrow
Return

Group feature selection using non-class data

delete2025-04-24
delete0
PRE
AI
李春娜 cover
李春娜 (Chun‐Na Li)
Y
Yuangang Pan
W
Wei-Jie Chen
I
Ivor W. Tsang
邵元海 (Yuan‐Hai Shao) *
DOI:10.1007/s10994-025-06773-6delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Existing embedded feature selection methods barely let non-class data contribute to feature selection. However, in some learning tasks, when non-class data have contribution to classification, they should also have an influence to the selection of useful features. For instance, F-infinity-norm support vector machine is an effective embedded group feature selection method that performs classification simultaneously. In this paper, we find out that it implicitly uses a kind of non-class data formulated as coordinate Universum when implementing group feature selection, and the information contained in this non-class data could be a meaningful group-wise F-infinity-norm penalization. As far as we know, this is the first time that F-infinity-norm penalization is understood from this angle. We prove that useful features can be identified through this non-class data that contribute to classifier construction. In addition, to fully explore the classification information provided by this non-class data, we improve F-infinity-norm support vector machine by deeming the non-class data as a middle class to better classify positive and negative classes. Experiments show that the non-class data in the proposed method help reduce the labelled data in some sense. Furthermore, it improves F-infinity-norm support vector machine in terms of both classification and group feature selection.
Keywords:
Group feature selection
Non-class data
Universum
Support vector machine
F-infinity-norm

Journal

Machine Learning cover
Machine Learning
IF:
2.9
Papers:
2.6K
Citations:
3.4W

Organization

A
ASTAR
Scholars:
1.1K
Papers: 442
Citations: 233
Z
Zhejiang Univ Technol
Scholars:
2.7K
Papers: 978
Citations: 382