返回
Reinforcement learning explains various conditional cooperation
DOI:10.1016/j.amc.2022.127182.png)
摘要
En 中文
Recent studies show that different update rules are invariant regarding the evolutionary outcomes for a well-mixed population or homogeneous network. In this paper, we investi-gate how the Q-learning algorithm, one of the reinforcement learning methods, affects the evolutionary outcomes in square lattice. Especially, we consider the mixed strategy update rule, among which some agents adopt Q-learning method to update their strategies, the proportion of these agents (these agents are denoted as Artificial Intelligence (AI)) is con-trolled by a simple parameter rho. The rest of other agents, the proportion is denoted by 1 - rho, adopt the Fermi function to update their strategies. Through extensive numerical simulations, we found that the mixed strategy-update rule can facilitate cooperation com-pared with the pure Fermi-function-based update rule. Besides, if the proportion of AI is moderate, cooperators among the whole population exhibit conditional behavior and moody conditional behavior. However, if the whole population adopts the pure Fermi-function-based strategy update rule or the pure Q-learning-based strategy update rule, then cooperators among the whole population exhibit the hump-shaped conditional be-havior. Our results provide a new insight to understand the evolution of cooperation from AI's view. (c) 2022 Elsevier Inc. All rights reserved.
Keyword:
Evolutionary games
Q-learning
Conditional cooperation
期刊
IF:
3.4
论文数:
2.3W
被引数:
3.3W
机构
引用论文
Application of the cluster model to the study of ordering of atom strings in ternary W-Nb oxides团簇模型在三元w-nb氧化物原子串有序化研究中的应用
Reinforcement learning accounts for moody conditional cooperation behavior: experimental results
SCIENTIFIC REPORTS
IF3.9
Estradiol attenuates alpha 2-adrenoceptor-mediated inhibition of hypothalamic norepinephrine release
Explainable Machine Learning for Scientific Insights and Discoveries用于科学见解和发现的可解释机器学习
IEEE ACCESS
IF3.6

