.png){kind=icon}
返回
Decoupled representation for multi-view learning
.png){kind=icon}
PRE
AI
DOI：10.1016/j.patcog.2024.110377.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Learning multi -view data is a central topic for advanced deep model applications. Existing efforts mainly focus on exploring shared information to maximize the consensus among all the views. However, after reasonably discarding superfluous task -irrelevant noise, the view -specific information is equally essential to downstream tasks. In this paper, we propose to decouple the multi -view representation learning into the shared and specific information extractions with parallel branches, and seamlessly adopt feature fusion in end -to -end models. The common feature is obtained based on the view -agnostic contrastive learning and view -discriminative training to minimize the discrepancy within the views. Simultaneously, the specific feature is learned with orthogonality constraints to minimize the view -level correlation. Besides, the semantic information in the features is reserved with supervised training. After disentangling the representations, we fuse the mutually complementary common and specific features for downstream tasks. Particularly, we provide a theoretical explanation for our method from an information bottleneck perspective. Compared with state-of-the-art multi -view models on benchmark datasets, we empirically demonstrate the advantage of our method in several downstream tasks, such as ordinary classification and few -shot learning. In addition, extensive experiments validate the robustness and transferability of our approach, when applying the learned representation on the source dataset to several target datasets.
Keyword:
Multi-view learning
Representation learning
Information bottleneck
Contrastive learning
期刊
IF:
7.6
论文数:
1.3W
被引数:
4.5W
机构
引用论文
Triple-attention interaction network for breast tumor classification based on multi-modality images.png)
PATTERN RECOGNITION
PATTERN RECOGNITIONIF7.6
PREAI
分享收藏Robust semi-supervised multi-view graph learning with sharable and individual structurePATTERN RECOGNITION
PATTERN RECOGNITIONIF7.6
PREAI
分享收藏分享收藏分享收藏分享收藏
分享收藏分享收藏
查看更多内容