arrow
返回

Laplacian Welsch Regularization for Robust Semisupervised Learning

delete2022-01-01
delete19
PRE
AI
J
Jingchen Ke
龚晨 封面图
龚晨 (Chen Gong) *
T
Tongliang Liu
赵林 (Lin Zhao)
J
Jian Yang
D
Dacheng Tao
DOI:10.1109/TCYB.2019.2953337delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Semisupervised learning (SSL) has been widely used in numerous practical applications where the labeled training examples are inadequate while the unlabeled examples are abundant. Due to the scarcity of labeled examples, the performances of the existing SSL methods are often affected by the outliers in the labeled data, leading to the imperfect trained classifier. To enhance the robustness of SSL methods to the outliers, this article proposes a novel SSL algorithm called Laplacian Welsch regularization (LapWR). Specifically, apart from the conventional Laplacian regularizer, we also introduce a bounded, smooth, and nonconvex Welsch loss which can suppress the adverse effect brought by the labeled outliers. To handle the model nonconvexity caused by the Welsch loss, an iterative half-quadratic (HQ) optimization algorithm is adopted in which each subproblem has an ideal closed-form solution. To handle the large datasets, we further propose an accelerated model by utilizing the Nystrom method to reduce the computational complexity of LapWR. Theoretically, the generalization bound of LapWR is derived based on analyzing its Rademacher complexity, which suggests that our proposed algorithm is guaranteed to obtain satisfactory performance. By comparing LapWR with the existing representative SSL algorithms on various benchmark and real-world datasets, we experimentally found that LapWR performs robustly to outliers and is able to consistently achieve the top-level results.
Keyword:
Robustness
Laplace equations
Optimization
Manifolds
Computational modeling
Training
Semisupervised learning
Generalization bound
half-quadratic (HQ) optimization
Nystrom method
semisupervised learning (SSL)
Welsch loss
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Cybernetics 封面图
IEEE Transactions on Cybernetics
IF:
10.5
论文数:
1.1W
被引数:
5.0W

机构

U
University of Sydney
学者数:
6.5W
论文数: 6.2W
被引数: 90
引用论文

引用论文

An Adaptive Semisupervised Feature Analysis for Video Semantic Recognition
err2018-02-01
err279
PREAI
errLuo, Minnan; Chang, Xiaojun; Nie, Liqiang; Yang, Yi; Hauptmann, Alexander G.; Zheng, Qinghua
err分享
err收藏
err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
err分享
err收藏
Native point defects in ZnS films
err2009-12-01
err0
PREAI
errD. Kurbatov; V. Kosyak; A. Opanasyuk; V. Melnik
err分享
err收藏
p-Laplacian Regularization for Scene Recognition
err2019-08-01
err94
PREAI
errLiu, Weifeng; Ma, Xuegi; Zhou, Yicong; Tao, Dapeng; Cheng, Jun
err分享
err收藏
学者 查看更多内容