返回
A population-based approach for multi-agent interpretable reinforcement learning
DOI:10.1016/j.asoc.2023.110758.png)
摘要
En 中文
Multi-Agent Reinforcement Learning (MARL) made significant progress in the last decade, mainly thanks to the major developments in the field of Deep Neural Networks (DNNs). However, DNNs suffer from a fundamental issue: their lack of interpretability. While this is true for most applications of DNNs, this is exacerbated in their applications in MARL. In fact, the mutual interactions between agents and environment, as well as across agents, make it particularly difficult to understand learned strategies in these settings. One possible way to achieve explainability in MARL is through the use of interpretable models, such as decision trees, that allow for a direct inspection and understanding of their inner workings. In this work, we make a step forward in this direction, proposing a population based algorithm that combines evolutionary principles with RL for training interpretable models in multi-agent systems. We evaluate the proposed approach in a highly dynamic task where two teams of agents compete with each other. We test different variants of the proposed method in different settings, namely with/without coevolution and with/without initialization from a handcrafted policy. We find that, in most settings, our method is able to find fairly effective policies. Moreover, we show that the learned policies are easy to inspect and, possibly, interpreted based on domain knowledge.
Keyword:
Multi-Agent Reinforcement Learning
Evolutionary algorithm
Explainable artificial intelligence
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
6.6
论文数:
1.4W
被引数:
4.8W
机构
引用论文
Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI可解释人工智能 (XAI): 负责任人工智能的概念、分类、机遇和挑战
INFORMATION FUSION
IF15.5
A review of cooperative multi-agent deep reinforcement learning协作式多agent深度强化学习研究综述
APPLIED INTELLIGENCE
IF3.5
Learning Effective Skeletal Representations on RGB Video for Fine-Grained Human Action Quality Assessment
Electronics
IF0

