arrow
返回

Knowledge distillation-driven semi-supervised multi-view classification

delete2024-03-01
delete4
PRE
AI
王晓莉 封面图
王晓莉 (Xiaoli Wang)
Y
Yongli Wang *
K
Ke, Guanzhou
Y
Yupeng Wang
H
Hong, Xiaobin
DOI:10.1016/j.inffus.2023.102098delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Semi-supervised multi-view classification is a critical research topic that leverages the discrepancy between different views and limited annotated samples for pattern recognition in computer vision. However, it encounters a significant challenge: obtaining comprehensive discriminative representations with a scarcity of labeled samples. Although existing methods aim to learn discriminative features by fusing multi-view information, a significant challenge persists due to the difficulty of transferring complementary information and fusing multiple views with limited supervised information. In response to this challenge, this work introduces an innovative algorithm that integrates Self-Knowledge Distillation (Self-KD) to facilitate semi-supervised multi -view classification. Initially, we employ a view-specific feature extractor for each view to learn discriminative representations. Subsequently, we introduce a self-distillation module to drive information interaction across multiple views, enabling mutual learning and refinement of multi-view unified and specific representations. Moreover, we introduce a class-aware contrastive module to alleviate confirmation bias stemming from noise in the generated pseudo-labels during knowledge distillation. To the best of our knowledge, this is the first attempt to extend Self-KD to address semi-supervised multi-view classification problems. Extensive experimental results validate the efficiency of this approach in semi-supervised multi-view classification compared to existing state-of-the-art methods.
Keyword:
Multi-view learning
Semi-supervised classification
Self-knowledge distillation
Contrastive learning

期刊

Information Fusion 封面图
Information Fusion
IF:
15.5
论文数:
4.2K
被引数:
2.7W

机构

B
Beijing Jiaotong University
学者数:
2.2W
论文数: 1.7W
被引数: 1.2W
N
nanjing university
学者数:
7.8W
论文数: 5.6W
被引数: 87
引用论文

引用论文

Joint consensus and diversity for multi-view semi-supervised classification
err2019-10-07
err21
errOAAI
errZhuge, Wenzhang; Hou, Chenping; Peng, Shaoliang; Yi, Dongyun
err分享
err收藏
err分享
err收藏
Multi-view Teacher-Student Network
err2022-02-01
err18
PREAI
errTian, Yingjie; Sun, Shiding; Tang, Jingjing
err分享
err收藏
学者 查看更多内容