返回
Knowledge-Based Multiagent Credit Assignment: A Study on Task Type and Critic Information
DOI:10.1109/JSYST.2007.901641.png)
摘要
En 中文
Multiagent credit assignment (MCA) is one of the major problems in the realization of multiagent reinforcement learning. Since the environment usually is not intelligent enough to qualify individual agents in a cooperative team, it is very important to develop some methods for assigning individual agents' credits when just a single team reinforcement is available. MCA cannot be solved in general cases, using a single technique. Therefore, our goal in this research is first to present a new view of the problem and second, to introduce a new idea of using agents' knowledge to partially solve MCA. In this research, an approach that is based on agents' learning histories and knowledge is proposed to solve the MCA problem. Knowledge evaluation-based credit assignment (KEBCA) along with certainty, a measure of agents' knowledge, is developed to judge agents' actions and to assign them proper credits. The proposed KEBCA method is general, however; we study it in some simulated extreme cases in order to gain a better insight into MCA problem and to evaluate our approach in such cases. More specifically, we study the effects of task type (AND-type and OR-type tasks) on solving MCA problem in two cases. In the first case, in addition to the team reinforcement, it is assumed that some extra information at the team level is available. In the second case, such extra information does not exist. In addition, performance of the system is examined in presence of some uncertainties in the environment, modeled as noise on agents' actions. The information content of team reinforcements and assumed extra information are theoretically calculated and discussed. The mathematical calculations confirm the related simulation results.
Keyword:
Credit assignment
multiagent learning
reinforcement learning
期刊
I
IF:
2.4
论文数:
4.5K
被引数:
387
机构
引用论文
PREVALENCE OF RISK FACTORS AND SCREENING RATES FOR OSTEOPOROSIS IN ESKD PATIENTS ON HEMODIALYSISESKD患者行血液透析时骨质疏松危险因素患病率及筛查率
PERSISTENT CELL-FREE DNA ELEVATION IN A STABLE KIDNEY TRANSPLANT RECIPIENT: A DIAGNOSTIC CHALLENGE IN CHRONIC GRAFT INJURY稳定肾移植受者中持续的游离DNA升高:慢性移植物损伤的诊断挑战
ACUTE INTERSTITIAL NEPHRITIS AND ACUTE TUBULAR INJURY ASSOCIATED WITH NOVEL DRUGS FOR NON-SMALL CELL LUNG CANCER: AVUTOMETINIB AND ADAGRASIB急性间质性肾炎和急性肾小管损伤与非小细胞肺癌新型药物相关:Avutometinib 和 Adagrasib
PETTING ZOO PERILS: E. COLI O157:H7 AND HEMOLYTIC UREMIC SYNDROME小动物互动区的风险:E. coli O157:H7 和溶血性尿毒症综合征

