arrow
Return

User Behavior Simulation with Large Language Model-based Agents

delete2025-01-28
delete0
PRE
AI
L
Lei Wang *
J
Jingsen Zhang
H
Hao Yang
Z
Z. P. Chen
J
Jiakai Tang
Z
Zeyu Zhang
X
Xu Chen
Y
Yankai Lin
孙昊 cover
孙昊 (Hao Sun)
宋睿华 (Ruihua Song)
赵鑫 (Wayne Xin Zhao)
徐君 (Jun Xu)
窦志成 (Zhicheng Dou)
J
Jun Wang
J
Ji-Rong Wen
DOI:10.1145/3708985delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Simulating high quality user behavior data has always been a fundamental yet challenging problem in human- centered applications such as recommendation systems, social networks, among many others. The major difficulty of user behavior simulation originates from the intricate mechanism of human cognitive and decision processes. Recently, substantial evidence has suggested that by learning huge amounts of web knowledge, large language models (LLMs) can achieve human-like intelligence and generalization capabilities. Inspired by such capabilities, in this article, we take an initial step to study the potential of using LLMs for user behavior simulation in the recommendation domain. To make LLMs act like humans, we design profile, memory and action modules to equip them, building LLM-based agents to simulate real users. To enable interactions between different agents and observe their behavior patterns, we design a sandbox environment, where each agent can interact with the recommendation system, and different agents can converse with their friends via one-to-one chatting or one-to-many social broadcasting. In the experiments, we first demonstrate the believability of the agent-generated behaviors based on both subjective and objective evaluations. Then, to show the potential applications of our method, we simulate and study two social phenomena including (1) information cocoons and (2) user conformity behaviors. We find that controlling the personalization degree of recommendation algorithms and improving the heterogeneity of user social relations can be two effective strategies for alleviating the problem of information cocoon, and the conformity behaviors can be highly influenced by the amount of user social relations. To advance this direction, we have released our project at https://github.com/RUC-GSAI/YuLan-Rec.
Keywords:
recommender system
large language mode
user simulation

Journal

ACM Transactions on Information Systems cover
ACM Transactions on Information Systems
IF:
9.1
Papers:
1.2K
Citations:
4.7K

Organization

R
Renmin University of China
Scholars:
8.1K
Papers: 7.7K
Citations: 1.1W
U
university of london
Scholars:
21.5W
Papers: 19.7W
Citations: 305