arrow
返回

Behavior Reasoning for Opponent Agents in Multi-Agent Learning Systems

delete2022-10-01
delete8
PRE
AI
Y
Yaqing Hou
M
Mingyang Sun
W
Wenxuan Zhu
Y
Yifeng Zeng
H
Haiyin Piao *
X
Xuefeng Chen
张
张强 (Qiang Zhang) *
DOI:10.1109/TETCI.2022.3147011delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
One important component of developing autonomous agents lies in the accurate prediction of their opponents' behaviors when the agents interact with others in an uncertain environment. Most recent study focuses on first constructing predictive types (or models) of the opponents, considering their various properties of interest, and subsequently using these models to predict their behaviors accordingly. However, as the possible type space can be rather large, it is time-consuming, and sometimes even infeasible, to predict the actual behaviors of opponents with all candidate types. Thus, in this paper a tractable opponent behavior reasoning approach is proposed that facilitates ($a$) extraction of a small yet representative summary of all candidates using sub-modular-type maximization, and accordingly, ($b$) identification of the most appropriate type for real-time behavior prediction based on multi-armed bandits. In addition, we propose a knowledge-transfer scheme through demonstration learning to synchronize subject agents' knowledge about their opponents' behaviors. This further reduces the burden of reasoning with all models of their opponents from the perspective of individual subject agents. We integrate the new behavior prediction and reasoning method into a state-of-the-art evolutionary multi-agent framework, namely a memetic multi-agent system (MeMAS), and demonstrate empirical performance in two problem domains.
Keyword:
Computational modeling
Cognition
Task analysis
Predictive models
Multi-agent systems
Memetics
Real-time systems
Opponent modeling
multi-agent systems
behavior prediction and reasoning
memetic computing

期刊

I
IEEE Transactions on Emerging Topics in Computational Intelligence
IF:
6.5
论文数:
1.4K
被引数:
4.5K

机构

C
Chongqing University
学者数:
5.1W
论文数: 4.1W
被引数: 6.0W
N
Northwestern Polytechnical University
学者数:
4.6W
论文数: 3.7W
被引数: 5.3W
D
Dalian University of Technology
学者数:
6.0W
论文数: 4.4W
被引数: 5.5W
N
Northumbria University
学者数:
5.6K
论文数: 6.8K
被引数: 9.5K
学者 查看更多机构
引用论文

引用论文

err分享
err收藏
Bond Behavior between BFRP Rebar and Seawater Sea Sand Concrete
err2020-09-25
err0
errOAAI
errChao Wu; Bing-Chen Meng; Xianfeng Cheng; Asghar Habibnejad Korayem; Lik-Ho Tam
err分享
err收藏
Structured Memetic Automation for Online Human-Like Social Behavior Learning
err2017-02-01
err17
errOAAI
errZeng, Yifeng; Chen, Xuefeng; Ong, Yew-Soon; Tang, Jing; Xiang, Yanping
err分享
err收藏
The Effect of Voter Identification Laws on Turnout
err2008-01-01
err0
errOAAI
errR. Michael Michael Alvarez; Delia Bailey; Jonathan N. Katz
err分享
err收藏
Belief and truth in hypothesised behaviours
err2016-06-01
err35
errOAAI
errAlbrecht, Stefano V.; Crandall, Jacob W.; Ramamoorthy, Subramanian
err分享
err收藏
A Multi-Facet Survey on Memetic Computation模因计算的多面性综述
err2011-10-01
err397
PREAI
errChen, Xianshun; Ong, Yew-Soon; Lim, Meng-Hiot; Tan, Kay Chen
err分享
err收藏
Syntaxin 11 marks a distinct intracellular compartment recruited to the immunological synapse of NK cells to colocalize with cytotoxic granules
err2011-12-29
err0
errOAAI
errAlena Dabrazhynetskaya; Jinxia Ma; Andre Ortlieb Guerreiro‐Cacais; Zita Arany; Eva Rudd; Jan‐Inge Henter; Klas Karre; Jelena Levitskaya; Victor Levitsky
err分享
err收藏
Advances in Memetic Automaton: Toward Human-Like Autonomous Agents in Complex Multi-Agent Learning Problems
err2021-11-01
err5
PREAI
errHou, Yaqing; Yu, Xiangchao; Zeng, Yifeng; Wei, Ziqi; Zhang, Haijun; Ge, Hongwei; Zhang, Qiang
err分享
err收藏
学者 查看更多内容