arrow
Return

An Adaptive Graph Pre-training Framework for Localized Collaborative Filtering

delete2022-12-21
delete16
delete
OA
AI
Y
Yiqi Wang
C
Chaozhuo Li *
Z
Zheng Liu
M
Mingzheng Li
J
Jiliang Tang
X
Xing Xie
陈蕾 cover
陈蕾 (Lei Chen)
P
Philip S. Yu
DOI:10.1145/3555372delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Graph neural networks (GNNs) have been widely applied in the recommendation tasks and have achieved very appealing performance. However, most GNN-based recommendation methods suffer from the problem of data sparsity in practice. Meanwhile, pre-training techniques have achieved great success in mitigating data sparsity in various domains such as natural language processing (NLP) and computer vision (CV). Thus, graph pre-training has the great potential to alleviate data sparsity in GNN-based recommendations. However, pre-training GNNs for recommendations faces unique challenges. For example, user-item interaction graphs in different recommendation tasks have distinct sets of users and items, and they often present different properties. Therefore, the successful mechanisms commonly used in NLP and CV to transfer knowledge from pre-training tasks to downstream tasks such as sharing learned embeddings or feature extractors are not directly applicable to existing GNN-based recommendations models. To tackle these challenges, we delicately design an adaptive graph pre-training framework for localized collaborative filtering (ADAPT). It does not require transferring user/item embeddings, and is able to capture both the common knowledge across different graphs and the uniqueness for each graph simultaneously. Extensive experimental results have demonstrated the effectiveness and superiority of ADAPT.
Keywords:
Graph neural networks
recommendation systems
model pre-training

Journal

ACM Transactions on Information Systems cover
ACM Transactions on Information Systems
IF:
9.1
Papers:
1.2K
Citations:
4.7K

Organization

M
Microsoft Research Asia
Scholars:
421
Papers: 407
Citations: 2
M
Microsoft
Scholars:
3.0K
Papers: 2.7K
Citations: 7
M
michigan state university
Scholars:
3.6W
Papers: 3.2W
Citations: 44
M
microsoft china
Scholars:
130
Papers: 112
Citations: 0
researcher View more organizations
Cited Papers

Cited Papers

err
IF0
err
err0
PREAI
err
errShare
errSave
Understanding quaternions
err2011-03-01
err0
PREAI
errRon Goldman
errShare
errSave
errShare
errSave
Long-Term Longitudinal Patterns of Patient-Reported Fatigue After Breast Cancer: A Group-Based Trajectory Analysis
err2022-07-01
err0
errOAAI
errInes Vaz-Luis; Antonio Di Meglio; Julie Havas; Mayssam El-Mouhebb; Pietro Lapidari; Daniele Presti; Davide Soldato; Barbara Pistilli; Agnes Dumas; Gwenn Menvielle; Cecile Charles; Sibille Everhard; Anne-Laure Martin; Paul H. Cottu; Florence Lerebours; Charles Coutant; Sarah Dauchy; Suzette Delaloge; Nancy U. Lin; Patricia A. Ganz; Ann H. Partridge; Fabrice André; Stefan Michiels
errShare
errSave
The US college loans system: Lessons from Australia and England
err2019-08-01
err0
errOAAI
errNicholas Barr; Bruce Chapman; Lorraine Dearden; Susan Dynarski
errShare
errSave
researcher View more