arrow
返回

Reinforcement learning explains various conditional cooperation

delete2022-08-01
delete24
PRE
AI
Y
Yini Geng
Y
Yifan Liu
路亦康 封面图
路亦康 (Yikang Lu)
C
Chen Shen
石磊 封面图
石磊 (Лей Ши) *
DOI:10.1016/j.amc.2022.127182delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Recent studies show that different update rules are invariant regarding the evolutionary outcomes for a well-mixed population or homogeneous network. In this paper, we investi-gate how the Q-learning algorithm, one of the reinforcement learning methods, affects the evolutionary outcomes in square lattice. Especially, we consider the mixed strategy update rule, among which some agents adopt Q-learning method to update their strategies, the proportion of these agents (these agents are denoted as Artificial Intelligence (AI)) is con-trolled by a simple parameter rho. The rest of other agents, the proportion is denoted by 1 - rho, adopt the Fermi function to update their strategies. Through extensive numerical simulations, we found that the mixed strategy-update rule can facilitate cooperation com-pared with the pure Fermi-function-based update rule. Besides, if the proportion of AI is moderate, cooperators among the whole population exhibit conditional behavior and moody conditional behavior. However, if the whole population adopts the pure Fermi-function-based strategy update rule or the pure Q-learning-based strategy update rule, then cooperators among the whole population exhibit the hump-shaped conditional be-havior. Our results provide a new insight to understand the evolution of cooperation from AI's view. (c) 2022 Elsevier Inc. All rights reserved.
Keyword:
Evolutionary games
Q-learning
Conditional cooperation

期刊

Applied Mathematics and Computation 封面图
Applied Mathematics and Computation
IF:
3.4
论文数:
2.3W
被引数:
3.3W

机构

H
Hunan Normal University
学者数:
1.3W
论文数: 8.2K
被引数: 9.1K
Y
Yunnan University of Finance and Economics
学者数:
866
论文数: 782
被引数: 779
引用论文

引用论文

Imaging of cells by autofluorescence: a new tool in the probing of biopharmaceutical effects at the intracellular level
err2010-12-23
err0
PREAI
errMarc Dellinger; Marc Geze; René Santus; Elli Kohen; Cahide Kohen; Joseph G. Hirschberg; Marco Monti
err分享
err收藏
Reinforcement learning accounts for moody conditional cooperation behavior: experimental results
err2017-01-10
err34
errOAAI
errHorita, Yutaka; Takezawa, Masanori; Inukai, Keigo; Kita, Toshimasa; Masuda, Naoki
err分享
err收藏
Coevolution of Vertex Weights Resolves Social Dilemma in Spatial Networks
err2017-11-09
err43
errOAAI
errShen, Chen; Chu, Chen; Guo, Hao; Shi, Lei; Duan, Jiangyan
err分享
err收藏
Association of clinical events with everolimus exposure in kidney transplant patients receiving reduced cyclosporine
err2012-12-12
err0
errOAAI
errFuad S. Shihab; Diane Cibrik; Laurence Chan; Yu Seun Kim; Mario Carmellini; Rowan Walker; Gazi Zibari; James Pattison; Catherine Cornu‐Artis; Zailong Wang; Helio Tedesco‐Silva Jr
err分享
err收藏
err分享
err收藏
学者 查看更多内容