arrow
返回

Multi-modal data clustering using deep learning: A systematic review

delete2024-11-01
delete2
PRE
AI
S
S.P. Raya
M
Mariam Orabi
I
Imad Afyouni
Z
Zaher Al Aghbari *
DOI:10.1016/j.neucom.2024.128348delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Multi-modal clustering represents a formidable challenge in the domain of unsupervised learning. The objective of multi-modal clustering is to categorize data collected from diverse modalities, such as audio, visual, and textual sources, into distinct clusters. These clustering techniques operate by extracting shared features across modalities in an unsupervised manner, where the identified common features exhibit high correlations within real-world objects. Recognizing the importance of perceiving the correlated nature of these features is vital for enhancing clustering accuracy in multi-modal settings. This survey explores Deep Learning (DL) techniques applied to multi-modal clustering, encompassing methodologies such as Convolutional Neural Networks (CNN), Autoencoders (AE), Recurrent Neural Networks (RNN), and Graph Convolutional Networks (GCN). Notably, this survey represents the first attempt to investigate DL techniques specifically for multi-modal clustering. The survey presents a novel taxonomy for DL-based multi-modal clustering, conducts a comparative analysis of various multi-modal clustering approaches, and deliberates on the datasets employed in the evaluation process. Additionally, the survey identifies research gaps within the realm of multi-modal clustering, offering insights into potential future avenues for research.
Keyword:
Multi-modal data
Clustering algorithms
Deep learning
Review article

期刊

Neurocomputing 封面图
Neurocomputing
IF:
6.5
论文数:
2.5W
被引数:
6.5W

机构

U
University of Sharjah
学者数:
5.9K
论文数: 5.5K
被引数: 8.8K
引用论文

引用论文

Biochemical reconstitution of branching microtubule nucleation
err
IF0
err2019-07-11
err0
errOAAI
errRaymundo Alfaro-Aco; Akanksha Thawani; Sabine Petry
err分享
err收藏
DEEP-AD: A Multimodal Temporal Video Segmentation Framework for Online Video Advertising
err2020-01-01
err6
errOAAI
errTapu, Ruxandra; Mocanu, Bogdan; Zaharia, Titus
err分享
err收藏
学者 查看更多内容