arrow
Return

A Progressive Stacking Pseudoinverse Learning Framework via Active Learning in Random Subspaces

delete2024-05-01
delete1
PRE
AI
Z
Zhenjiao Cai
张素兰 (Sulan Zhang) *
P
Ping Guo
张继福 (Jifu Zhang)
胡立华 (Lihua Hu)
DOI:10.1109/TSMC.2024.3352019delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
SP is an ensemble learning technology, and its generalization performance greatly affects the effect of image classification. Currently, most stacking pseudoinverse learners (SPs) randomly initialize the input weight matrix in a random subspace without limiting the random initial values, resulting in unstable training results and a decrease in generalization performance; in addition, training all samples at once may cause the classifier redundant and also affect the generalization performance of the model. To efficiently address the above issues, we propose a new framework called progressive stacking pseudoinverse learner (PSP), which aims to enhance the generalization performance of SP via active learning (AL) in random subspaces. Specifically, on the one hand, a random feature SP (RFSP) model is proposed, which constrains the random subspace by initializing the input weight matrix into different random specific distributions to improve the generalization performance of SP. On the other hand, an AL progressive (ALP) model based on RFSP is proposed. By iteratively selecting useful samples to optimize the classification results, the training sample information is effectively used to progressively enhance the generalization performance of the model. Experimental results on three public datasets show that our proposed PSP algorithm achieves better performance in accuracy, precision, recall, and $F$ 1 score, and the results are competitive with state-of-the-art methods.
Keywords:
generalization performance
progressive stack
random subspace
Active learning (AL)
stacking pseudoinverse learner (SP)

Journal

IEEE Transactions on Cybernetics cover
IEEE Transactions on Cybernetics
IF:
10.5
Papers:
1.1W
Citations:
5.0W

Organization

B
Beijing Normal University
Scholars:
3.3W
Papers: 2.7W
Citations: 4.2W
T
taiyuan university of science & technology
Scholars:
3.5K
Papers: 2.3K
Citations: 3