arrow
Return

Graph contrastive learning with consistency regularization

delete2024-05-01
delete0
PRE
AI
S
Soo‐Hong Lee
S
Sangho Lee
J
Jaehwan Lee
W
Woojin Lee *
Y
Youngdoo Son *
DOI:10.1016/j.patrec.2024.03.014delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Contrastive learning has actively been used for unsupervised graph representation learning owing to its success in computer vision. Most graph contrastive learning methods use instance discrimination. It treats each instance as a distinct class against a query instance as the pretext task. However, such methods inevitably cause a class collision problem because some instances may belong to the same class as the query. Thus, the similarity shared through instances from the same class cannot be reflected in the pre-training stage. To address this problem, we propose graph contrastive learning with consistency regularization (GCCR), which introduces consistency regularization term to graph contrastive learning. Unlike existing methods, GCCR can obtain graph representation that reflects intra-class similarity by introducing a consistency regularization term. To verify the effectiveness of the proposed method, we performed extensive experiments and demonstrated that GCCR improved the quality of graph representations for most datasets. Notably, experimental results in various settings show that the proposed method can learn effective graph representations with better robustness against transformations than other state-of-the-art methods.
Keywords:
Contrastive learning
Class collision
Consistency regularization
Graph representation learning
Graph neural network

Journal

Pattern Recognition Letters cover
Pattern Recognition Letters
IF:
3.3
Papers:
7.9K
Citations:
1.6W

Organization

D
Dongguk University
Scholars:
8.2K
Papers: 9.3K
Citations: 1.0W