arrow
返回

Multi-label regularized quadratic programming feature selection algorithm with Frank-Wolfe method

delete2018-04-01
delete11
PRE
AI
J
Jianhua Xu *
DOI:10.1016/j.eswa.2017.11.018delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Feature selection is an effective pre-processing step to remove possible redundant and irrelevant features for various machine learning paradigms, which can help build a more understandable machine learning based component in hybrid expert systems. Single-label quadratic programming feature selection (QPFS) model is formulated as a QP problem with a unit simplex constraint to both minimize feature-feature redundancy and maximize feature-label relevance simultaneously. Since its redundancy matrix is desired not to be positive semi-definite and then estimated by Nystrom low-rank approximation method, its performance depends greatly on under-sampling rate and random permutation. In this paper, without any approximation, we extend this model to construct a regularized version (rQPFS), resulting in a strictly convex QP problem, to achieve a globally optimal subset of features. To reduce the increment of computational time for entire redundancy matrix, Frank-Wolfe method with a sub-linear convergence rate and its special cases for strictly convex function and unit simplex constraint are applied to solve our rQPFS efficiently. Furthermore, to tackle multi-label FS paradigm, pruned problem transformation trick is used to evaluate feature-label relevance to describe label correlations sufficiently. The detailed experimental study on eight data sets shows that our proposed method performs the best, compared with six state-of-the-art multi-label FS methods, according to six instance-based performance evaluation measures. (C) 2017 Elsevier Ltd. All rights reserved.
Keyword:
Multi-label classification
Hybrid expert systems
Feature selection
Quadratic programming
Regularization
Frank-Wolfe method
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Expert Systems with Applications 封面图
Expert Systems with Applications
IF:
7.5
论文数:
3.0W
被引数:
10.2W

机构

N
Nanjing Normal University
学者数:
1.7W
论文数: 1.3W
被引数: 1.9W
引用论文

引用论文

Mutual information-based feature selection for multilabel classification
err2013-12-01
err115
PREAI
errDoquire, Gauthier; Verleysen, Michel
err分享
err收藏
Information-theoretic feature selection for functional data classification
err2009-10-01
err46
PREAI
errGomez-Verdejo, Vanessa; Verleysen, Michel; Fleury, Jerome
err分享
err收藏
Antiphospholipid Antibodies Affect Human Endometrial Angiogenesis: Protective Effect of a Synthetic Peptide (TIFI) Mimicking the Phospholipid Binding Site of β2glycoprotein I
err2013-05-07
err0
PREAI
errNicoletta Di Simone; Silvia D'Ippolito; Riccardo Marana; Fiorella Di Nicuolo; Roberta Castellani; Silvia S. Pierangeli; Pojen Chen; Chiara Tersigni; Giovanni Scambia; Pier Luigi Meroni
err分享
err收藏
err分享
err收藏
err分享
err收藏
err分享
err收藏
学者 查看更多内容