arrow
返回

Mutual-Taught Deep Clustering

delete2023-12-01
delete4
PRE
AI
Z
Zhanxuan Hu
王
王一琛 (Yichen Wang)
H
Hailong Ning
吴丹阳 封面图
吴丹阳 (Danyang Wu) *
聂
聂飞平 (Feiping Nie)
DOI:10.1016/j.knosys.2023.111100delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Deep clustering seeks to group data into distinct clusters using deep learning techniques. Existing approaches of deep clustering can be broadly categorized into two groups: offline clustering based on unsupervised representation learning and online clustering based on unsupervised classification. While both groups have demonstrated impressive performance in deep clustering, no study has explored the integration of their respective strengths. To this end, we propose Mutual-Taught Deep Clustering (MTDC), which unifies unsupervised representation learning and unsupervised classification into a framework while realizing mutual promotion using a novel mutual-taught mechanism. Specifically, MTDC alternates between predicting pseudolabels in label space and estimating semantic similarity in feature space during training. Moreover, pseudolabels provide weakly-supervised information to enhance unsupervised representation learning, while semantic similarities function as structural priors that regularize unsupervised classification. Consequently, unsupervised classification and unsupervised representation learning can mutually benefit from one another. MTDC is decoupled from prevailing deep clustering methods. For the sake of clarity, we build upon a straightforward baseline in this paper. Despite its simplicity, we demonstrate that MTDC is exceedingly efficacious and consistently enhances the baseline results by substantial margins. For example, MTDC achieves 2.5% similar to 7.9% (NMI), 3.0% 13.9% (ACC), and 3.1% similar to 16.7% (ARI) gains over the baseline on six widely used image datasets.
Keyword:
Clustering
Unsupervised learning
Representation learning

期刊

K
Knowledge-Based Systems
IF:
7.6
论文数:
1.2W
被引数:
4.5W

机构

X
xi'an jiaotong university
学者数:
9.3W
论文数: 6.7W
被引数: 75
N
Northwestern Polytechnical University
学者数:
4.6W
论文数: 3.7W
被引数: 5.3W
引用论文

引用论文

Unsupervised deep clustering via contractive feature representation and focal loss
err2022-03-01
err48
PREAI
errCai, Jinyu; Wang, Shiping; Xu, Chaoyang; Guo, Wenzhong
err分享
err收藏
Unsupervised contrastive learning for seismic facies characterization
err2022-10-03
err18
PREAI
errLi, Jintao; Wu, Xinming; Ye, Yueming; Yang, Cun; Hu, Zhanxuan; Sun, Xiaoming; Zhao, Tao
err分享
err收藏
err分享
err收藏
Deep Clustering With Sample-Assignment Invariance Prior
err2020-11-01
err125
PREAI
errPeng, Xi; Zhu, Hongyuan; Feng, Jiashi; Shen, Chunhua; Zhang, Haixian; Zhou, Joey Tianyi
err分享
err收藏
Visual seizures in children
err1987-07-01
err0
PREAI
errKosaburou Aso; Kazuyoshi Watanabe; Tamiko Negoro; Etuko Takaesu; Atushi Furune; Izumi Takahashi; Naoki Yamamoto; Kazushi Nomura
err分享
err收藏
err分享
err收藏
学者 查看更多内容