arrow
Return

SV-Learner: Support-Vector Contrastive Learning for Robust Learning With Noisy Labels

delete2024-10-01
delete0
PRE
AI
Y
Yanli Ji *
W
Wei‐Shi Zheng
左旺孟 (Wangmeng Zuo)
X
Xiaofeng Zhu
DOI:10.1109/TKDE.2024.3386829delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Noisy-label data inevitably gives rise to confusion in various perception applications. In this work, we revisit the theory of support vector machines (SVMs) which mines support vectors to build the maximum-margin hyperplane for robust classification, and propose a robust-to-noise deep learning framework, SV-Learner, including the Support Vector Contrastive Learning (SVCL) and Support Vector-based Noise Screening (SVNS). The SV-Learner mines support vectors to solve the learning problem with noisy labels (LNL) reliably. SVCL adopts support vectors as positive and negative samples, driving robust contrastive learning to enlarge the feature distribution margin for learning convergent feature distributions. SVNS uses support vectors with valid labels to assist in screening noisy ones from confusable samples for reliable clean-noisy sample screening. Finally, Semi-Supervised classification is performed to realize the recognition of noisy samples. Extensive experiments are evaluated on CIFAR-10, CIFAR-100, Clothing1M, and Webvision datasets, and results demonstrate the effectiveness of our proposed approach.
Keywords:
Noise measurement
Self-supervised learning
Vectors
Noise
Reliability
Training
Support vector machines
Learning with noisy labels
semi-supervised learning
support - vector contrastive learning (SVCL)

Journal

IEEE Transactions on Knowledge and Data Engineering cover
IEEE Transactions on Knowledge and Data Engineering
IF:
10.4
Papers:
6.8K
Citations:
3.2W

Organization

H
harbin institute of technology
Scholars:
8.0W
Papers: 6.6W
Citations: 66
S
Sun Yat Sen University
Scholars:
9.9W
Papers: 7.2W
Citations: 95