arrow
Return

Trusted Semi-Supervised Multi-View Classification With Contrastive Learning

delete2024-01-01
delete0
PRE
AI
王晓莉 cover
王晓莉 (Xiaoli Wang)
Y
Yongli Wang *
Y
Yupeng Wang
A
Anqi Huang
J
Jun Liu
DOI:10.1109/TMM.2024.3379079delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Semi-supervised multi-view learning is a remarkable but challenging task. Existing semi-supervised multi-view classification (SMVC) approaches mainly focus on performance improvement while ignoring decision reliability, which limits their deployment in safety-critical applications. Although several trusted multi-view classification methods are proposed recently, they rely on manual annotations. Therefore, this work emphasizes trusted multi-view classification learning under semi-supervised conditions. Different from existing SMVC methods, this work jointly models class probabilities and uncertainties based on evidential deep learning to formulate view-specific opinions. Moreover, unlike previous works that explore cross-view consistency in a single schema, this work proposes a multi-level consistency constraint. Specifically, we explore instance-level consistency on the view-specific representation space and category-level consistency on opinions from multiple views. Our proposed trusted graph-based contrastive loss nicely establishes the relationship between joint opinions and view-specific representations, which enables view-specific representations to enjoy a good manifold to improve classification performance. Overall, the proposed approach provides reliable and superior semi-supervised multi-view classification decisions. Extensive experiments demonstrate the effectiveness, reliability and robustness of the proposed model.
Keywords:
Semi-supervised learning
multi-view classification
contrastive learning
uncertainty estimation
Semi-supervised learning
multi-view classification
contrastive learning
uncertainty estimation

Journal

IEEE Transactions on Multimedia cover
IEEE Transactions on Multimedia
IF:
9.7
Papers:
4.5K
Citations:
2.4W

Organization

S
singapore university of technology & design
Scholars:
2.8K
Papers: 3.6K
Citations: 5