.png){kind=icon}
返回
Graph Embedding Contrastive Multi-Modal Representation Learning for Clustering
.png){kind=icon}
PRE
AI
DOI：10.1109/TIP.2023.3240863.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Multi-modal clustering (MMC) aims to explore complementary information from diverse modalities for clustering performance facilitating. This article studies challenging problems in MMC methods based on deep neural networks. On one hand, most existing methods lack a unified objective to simultaneously learn the inter- and intra-modality consistency, resulting in a limited representation learning capacity. On the other hand, most existing processes are modeled for a finite sample set and cannot handle out-of-sample data. To handle the above two challenges, we propose a novel Graph Embedding Contrastive Multi-modal Clustering network (GECMC), which treats the representation learning and multi-modal clustering as two sides of one coin rather than two separate problems. In brief, we specifically design a contrastive loss by benefiting from pseudo-labels to explore consistency across modalities. Thus, GECMC shows an effective way to maximize the similarities of intra-cluster representations while minimizing the similarities of inter-cluster representations at both inter- and intra-modality levels. So, the clustering and representation learning interact and jointly evolve in a co-training framework. After that, we build a clustering layer parameterized with cluster centroids, showing that GECMC can learn the clustering labels with given samples and handle out-of-sample data. GECMC yields superior results than 14 competitive methods on four challenging datasets. Codes and datasets are
Keyword:
Multi-modal learning
representation learning
clustering
self-supervision
期刊
IF:
13.7
论文数:
1.0W
被引数:
8.4W
机构
引用论文
Osteoblast-derived WISP-1 increases VCAM-1 expression and enhances prostate cancer metastasis by down-regulating miR-126.png)
Oncotarget
OAAI
OncotargetIF0
OAAI分享收藏Spectrophotometric Determination of Carbon Disulfide Using Bis(4-(4 -Nitrophenyl)azo-2-Nitrophenyl) Disulfide双 (4-硝基苯基) azo-2-Nitrophenyl) 二硫化物分光光度法测定二硫化碳
PREAI
分享收藏
Fast Parameter-Free Multi-View Subspace Clustering With Consensus Anchor Guidance共识锚引导的无参数多视图子空间快速聚类
PREAI
分享收藏
查看更多内容