arrow
Return

SCAE: Structural Contrastive Auto-Encoder for Incomplete Multi-View Representation Learning

delete2024-09-23
delete0
delete
OA
AI
M
Mengran Li
R
Ronghui Zhang
张
张勇 (Yong Zhang) *
X
Xinglin Piao
S
Shiyu Zhao
B
Baocai Yin
DOI:10.1145/3672078delete
deleteOriginal
deleteShare
deleteSave
Abstract

Abstract

En 中文
Describing an object from multiple perspectives often leads to incomplete data representation. Consequently, learning consistent representations for missing data from multiple views has emerged as a key focus in the realm of Incomplete Multi-view Representation Learning (IMRL). In recent years, various strategies, such as subspace learning, matrix decomposition, and deep learning, have been harnessed to develop numerous IMRL methods. In this article, our primary research revolves around IMRL, with a particular emphasis on addressing two main challenges. Firstly, we delve into the effective integration of intra-view similarity and contextual structure into a unified framework. Secondly, we explore the effective facilitation of information exchange and fusion across multiple views. To tackle these issues, we propose a deep learning approach known as Structural Contrastive Auto-Encoder (SCAE) to solve the challenges of IMRL. SCAE comprises two major components: intra-view structural representation learning and inter-view contrastive representation learning. The former involves capturing intra-view similarity by minimizing the Dirichlet energy of the feature matrix, while also applying spatial dispersion regularization to capture intra-view contextual structure. The latter encourages maximizing the mutual information of inter-view representations, facilitating information exchange and fusion across views. Experimental results demonstrate the efficacy of our approach in significantly enhancing model accuracy and robustly addressing IMRL problems. The code is available at https://github.com/limengran98/SCAE.
Keywords:
Incomplete multi-view representation learning
MC-VAE
Dirichlet energy
mutual information maximization
contrastive learning

Journal

ACM Transactions on Multimedia Computing Communications and Applications cover
ACM Transactions on Multimedia Computing Communications and Applications
IF:
6
Papers:
2.0K
Citations:
5.4K

Organization

S
Sun Yat Sen University
Scholars:
9.9W
Papers: 7.2W
Citations: 95
B
Beijing University of Technology
Scholars:
2.8W
Papers: 2.1W
Citations: 2.7W
Cited Papers

Cited Papers

An Increased Lateral Femoral Condyle Ratio Is a Risk Factor for Anterior Cruciate Ligament Injury
err2018-05-16
err0
PREAI
errThomas R. Pfeiffer; Jeremy M. Burnham; Jonathan D. Hughes; Ajay C. Kanakamedala; Elmar Herbst; Adam Popchak; Sven Shafizadeh; James J. Irrgang; Richard E. Debski; Volker Musahl
errShare
errSave
Hypergraph Transformer Neural Networks
err2023-04-07
err22
PREAI
errLi, Mengran; Zhang, Yong; Li, Xiaoyong; Zhang, Yuchen; Yin, Baocai
errShare
errSave
errShare
errSave
Dysregulation of microRNA expression drives aberrant DNA hypermethylation in basal-like breast cancer
err2013-11-29
err0
errOAAI
errRUPNINDER SANDHU; ASHLEY G. RIVENBARK; RANDI M. MACKLER; CHAD A. LIVASY; WILLIAM B. COLEMAN
errShare
errSave
researcher View more