arrow
返回

A population-based approach for multi-agent interpretable reinforcement learning

delete2023-11-01
delete6
delete
OA
AI
A
Andrea Ferigo
L
Leonardo Lucio Custode
G
Giovanni Iacca *
DOI:10.1016/j.asoc.2023.110758delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Multi-Agent Reinforcement Learning (MARL) made significant progress in the last decade, mainly thanks to the major developments in the field of Deep Neural Networks (DNNs). However, DNNs suffer from a fundamental issue: their lack of interpretability. While this is true for most applications of DNNs, this is exacerbated in their applications in MARL. In fact, the mutual interactions between agents and environment, as well as across agents, make it particularly difficult to understand learned strategies in these settings. One possible way to achieve explainability in MARL is through the use of interpretable models, such as decision trees, that allow for a direct inspection and understanding of their inner workings. In this work, we make a step forward in this direction, proposing a population based algorithm that combines evolutionary principles with RL for training interpretable models in multi-agent systems. We evaluate the proposed approach in a highly dynamic task where two teams of agents compete with each other. We test different variants of the proposed method in different settings, namely with/without coevolution and with/without initialization from a handcrafted policy. We find that, in most settings, our method is able to find fairly effective policies. Moreover, we show that the learned policies are easy to inspect and, possibly, interpreted based on domain knowledge.
Keyword:
Multi-Agent Reinforcement Learning
Evolutionary algorithm
Explainable artificial intelligence
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Applied Soft Computing 封面图
Applied Soft Computing
IF:
6.6
论文数:
1.4W
被引数:
4.8W

机构

U
University of Trento
学者数:
8.8K
论文数: 9.0K
被引数: 1.2W
引用论文

引用论文

Mini‐Mental State Examination
err2002-04-30
err0
PREAI
errJoseph R. Cockrell; Marshal F. Folstein
err分享
err收藏
Evolutionary Learning of Interpretable Decision Trees
err2023-01-01
err25
errOAAI
errCustode, Leonardo L.; Iacca, Giovanni
err分享
err收藏
err分享
err收藏
Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI可解释人工智能 (XAI): 负责任人工智能的概念、分类、机遇和挑战
err2020-06-01
err3.9K
errOAAI
errBarredo Arrieta, Alejandro; Diaz-Rodriguez, Natalia; Del Ser, Javier; Bennetot, Adrien; Tabik, Siham; Barbado, Alberto; Garcia, Salvador; Gil-Lopez, Sergio; Molina, Daniel; Benjamins, Richard; Chatila, Raja; Herrera, Francisco
err分享
err收藏
Morphological evolution for pipe inspection using Robot Operating System (ROS)
err2020-05-07
err10
errOAAI
errHallawa, Ahmed; Iacca, Giovanni; Sariman, Cagatay; Rahman, Touhidur; Cochez, Michael; Ascheid, Gerd
err分享
err收藏
Learning Effective Skeletal Representations on RGB Video for Fine-Grained Human Action Quality Assessment
err2020-03-28
err0
errOAAI
errQing Lei; Hong-Bo Zhang; Ji-Xiang Du; Tsung-Chih Hsiao; Chih-Cheng Chen
err分享
err收藏
GUMMOSIS OF TULIP BULBS CAUSED BY ETHYLENE
err1971-12-01
err0
PREAI
errG.A. Kamerbeek; A.L. Verlind; J.A. Schipper
err分享
err收藏
学者 查看更多内容