arrow
Return

A Pareto-Based Sparse Subspace Learning Framework

delete2019-11-01
delete10
PRE
AI
J
Juanjuan Luo *
焦李成 cover
焦李成 (Licheng Jiao)
刘
刘芳 (Fang Liu)
S
Shuyuan Yang
W
Wenping Ma
DOI:10.1109/TCYB.2018.2849442delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
High-dimensionality is a common characteristic of real-world data, which often results in high time and space complexity or poor performance of ensuing methods. Subspace learning, as one kind of dimension reduction method, provides a way to overcome the aforementioned problem. In this paper, we introduce multiobjective evolutionary optimization into subspace learning, and propose a Pareto-based sparse subspace learning algorithm for classification tasks. The proposed algorithm aims at minimizing two conflicting objective functions, the reconstruction error and the sparsity. A kernel trick derived from Gaussian kernel is implemented to the sparse subspace learning for the nonlinear phenomena of nature. In order to speed up the convergence, an entropy-driven initialization scheme and a gradient-descent mutation scheme are designed specifically. At last, a knee point is selected from the Pareto front to guarantee that we can obtain a solution with good classification performance, and yet as sparse as possible. The experiments and detailed analysis on real-life datasets and the hyperspectral images demonstrated that the proposed model achieves comparable results with the existing conventional subspace learning and evolutionary feature selection algorithms. Hence, this paper provides a more flexible and efficient approach for sparse subspace learning.
Keywords:
Classification
multiobjective optimization
Pareto solutions
sparse representation
subspace learning
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Cybernetics cover
IEEE Transactions on Cybernetics
IF:
10.5
Papers:
1.1W
Citations:
5.0W

Organization

B
beijing university of posts & telecommunications
Scholars:
1.4W
Papers: 1.2W
Citations: 9
X
Xidian University
Scholars:
2.4W
Papers: 1.9W
Citations: 9.7K
Cited Papers

Cited Papers

A Survey of Multiobjective Evolutionary Algorithms for Data Mining: Part I
err2014-02-01
err271
PREAI
errMukhopadhyay, Anirban; Maulik, Ujjwal; Bandyopadhyay, Sanghamitra; Coello Coello, Carlos Artemio
errShare
errSave
Subspace learning for unsupervised feature selection via matrix factorization
err2015-01-01
err142
PREAI
errWang, Shiping; Pedrycz, Witold; Zhu, Qingxin; Zhu, William
errShare
errSave
Modified Principal Component Analysis: An Integration of Multiple Similarity Subspace Models
err2014-08-01
err46
PREAI
errFan, Zizhu; Xu, Yong; Zuo, Wangmeng; Yang, Jian; Tang, Jinhui; Lai, Zhihui; Zhang, David
errShare
errSave
PCA and SVD with nonnegative loadings
err2009-01-01
err50
PREAI
errLipovetsky, Stan
errShare
errSave
errShare
errSave
errShare
errSave
researcher View more