arrow
Return

Improving Transformer-based Sequential Recommenders through Preference Editing

delete2023-04-10
delete12
delete
OA
AI
M
Muyang Ma *
P
Pengjie Ren
Z
Zhumin Chen
Z
Zhaochun Ren
H
Huasheng Liang
J
Jun Ma
M
Maarten de Rijke
DOI:10.1145/3564282delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
One of the key challenges in sequential recommendation is how to extract and represent user preferences. Traditional methods rely solely on predicting the next item. But user behavior may be driven by complex preferences. Therefore, these methods cannot make accurate recommendations when the available information user behavior is limited. To explore multiple user preferences, we propose a transformer-based sequential recommendation model, named MrTransformer (Multi-preference Transformer). For training MrTransformer, we devise a preference-editing-based self-supervised learning (SSL) mechanism that explores extra supervision signals based on relations with other sequences. The idea is to force the sequential recommendation model to discriminate between common and unique preferences in different sequences of interactions. By doing so, the sequential recommendation model is able to disentangle user preferences into multiple independent preference representations so as to improve user preference extraction and representation. We carry out extensive experiments on five benchmark datasets. MrTransformer with preference editing significantly outperforms state-of-the-art sequential recommendation methods in terms of Recall, MRR, and NDCG. We find that long sequences of interactions from which user preferences are harder to extract and represent benefit most from preference editing.
Keywords:
Transformer-based sequential recommendation
self-supervised learning
user preference extraction and representation

Journal

ACM Transactions on Information Systems cover
ACM Transactions on Information Systems
IF:
9.1
Papers:
1.2K
Citations:
4.7K

Organization

U
university of amsterdam
Scholars:
6.0W
Papers: 5.1W
Citations: 94
T
Tencent
Scholars:
1.1K
Papers: 898
Citations: 5
S
shandong university
Scholars:
9.5W
Papers: 6.4W
Citations: 94
researcher View more organizations
Cited Papers

Cited Papers

Lithium Dendrites: Inside or Outside: Origin of Lithium Dendrite Formation of All Solid‐State Electrolytes (Adv. Energy Mater. 40/2019)
err2019-10-24
err0
errOAAI
errFangjie Mo; Jiafeng Ruan; Shuxian Sun; Zixuan Lian; Sangpu Yang; Xinyang Yue; Yun Song; Yong‐Ning Zhou; Fang Fang; Guangai Sun; Shuming Peng; Dalin Sun
errShare
errSave
TECHNICAL SOLUTIONS TO IMPROVE PERFORMANCE OF THE RECYCLED CEMENT CONCRETE AGGREGATES FOR DURABLE ROAD PAVEMENTS
err2013-01-01
err0
PREAI
errNicolae Taranu; Marius Muscalu; Radu Andrei; Irina Lungu; Mihai Budescu; Bogdan Cazacliu
errShare
errSave
Effect of counselling with men on perceived stress and social support of their pregnant wives
err2020-07-16
err0
PREAI
errMaryam Mohammadpour; Sakineh Mohammad-Alizadeh Charandabi; Jamileh Malakouti; Mehriar Nadar Mohammadi; Mojgan Mirghafourvand
errShare
errSave
A Framework for Risk Management in Small Medium Enterprises in Developing Countries
err2022-09-01
err0
errOAAI
errZodwa Z. F. Mthiyane; Huibrecht M. van der Poll; Makgopa F. Tshehla
errShare
errSave
A Survey on Session-based Recommender Systems
err2021-07-18
err98
errOAAI
errWang, Shoujin; Cao, Longbing; Wang, Yan; Sheng, Quan Z.; Orgun, Mehmet A.; Lian, Defu
errShare
errSave
errShare
errSave
EGR-2 Is Not Required for In Vivo CD4 T Cell Mediated Immune Responses
err2010-09-23
err0
errOAAI
errHilda E. Ramón; Pedro J. Cejas; David LaRosa; Adeeb Rahman; John E. Harris; Jidong Zhang; Christopher Hunter; Yongwon Choi; Laurence A. Turka
errShare
errSave
Taurine prevents ?-glycerophosphate-induced calcification in cultured rat vascular smooth muscle cells
err2004-05-01
err0
PREAI
errBaohong Zhang; Zhiyu Huang; Shuhen Wang; Chaoshu Tang; Junbao Du; Juxiang Li
errShare
errSave
Genetic Models of Absence Epilepsy in Rats and Mice
err2017-01-01
err0
PREAI
errGuillaume Jarre; Isabelle Guillemain; Colin Deransart; Antoine Depaulis
errShare
errSave
researcher View more