.png){kind=icon}
返回
Simple learning rules to cope with changing environments
.png){kind=icon}
OA
AI
DOI：10.1098/rsif.2007.1348.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
We consider an agent that must choose repeatedly among several actions. Each action has a certain probability of giving the agent an energy reward, and costs may be associated with switching between actions. The agent does not know which action has the highest reward probability, and the probabilities change randomly over time. We study two learning rules that have been widely used to model decision-making processes in animals one deterministic and the other stochastic. In particular, we examine the influence of the rules' 'learning rate' on the agent's energy gain. We compare the performance of each rule with the best performance attainable when the agent has either full knowledge or no knowledge of the environment. Over relatively short periods of time, both rules are successful in enabling agents to exploit their environment. Moreover, under a range of effective learning rates, both rules are equivalent, and can be expressed by a third rule that requires the agent to select the action for which the current run of unsuccessful trials is shortest. However, the performance of both rules is relatively poor over longer periods of time, and under most circumstances no better than the performance an agent could achieve without knowledge of the environment. We propose a simple extension to the original rules that enables agents to learn about and effectively exploit a changing environment for an unlimited period of time.
Keyword:
decision making
learning rules
dynamic environments
multi-armed bandit
期刊
IF:
3.5
论文数:
4.8K
被引数:
1.7W
机构
引用论文
Pelabresib in Combination with Ruxolitinib for Janus Kinase Inhibitor Treatment-Naïve Patients with Myelofibrosis: Results of the MANIFEST-2 Randomized, Double-Blind, Phase 3 Study.png)
Blood
BloodIF0
PREAI
分享收藏Exploration or exploitation: life expectancy changes the value of learning in foraging strategiesOIKOS
OIKOSIF3
PREAI
分享收藏Direct transfer of molybdopterin cofactor to aponitrate reductase from a carrier protein in Chlamydomonas reinhardtiiFEBS Letters
OAAI
FEBS LettersIF0
OAAI分享收藏
查看更多内容