.png){kind=icon}
返回
Contrastive Learning-Based Agent Modeling for Deep Reinforcement Learning
.png){kind=icon}
PRE
AI
DOI：10.1109/TETCI.2025.3595684.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Multi-agent systems often require agents to collaborate with or compete against other agents with diverse goals, behaviors, or strategies. Agent modeling is essential when designing adaptive policies for intelligent machine agents in multi-agent systems, as this is the means by which the controlled agent (ego agent) understands other agents' (modeled agents) behavior and extracts their meaningful policy representations. These representations can be used to enhance the ego agent's adaptive policy which is trained by reinforcement learning. However, existing agent modeling approaches typically assume the availability of local observations from modeled agents during training or a long observation trajectory for policy adaption. To remove these constrictive assumptions and improve agent modeling performance, we devised a Contrastive Learning-based Agent Modeling (CLAM) method that relies only on the local observations from the ego agent during training and execution. With these observations, CLAM is capable of generating consistent high-quality policy representations in real time right from the beginning of each episode. We evaluated the efficacy of our approach in both cooperative and competitive multi-agent environments. The experiment results demonstrate that our approach improves reinforcement learning performance by at least 28% on cooperative and competitive tasks, which exceeds the state-of-the-art.
Keyword:
Adaptation models
Training
Trajectory
Reinforcement learning
Contrastive learning
Vectors
Predictive models
Multi-agent systems
Transformers
Real-time systems
Multi-agent system
agent modeling
contrastive learning
期刊
I
IF:
6.5
论文数:
1.4K
被引数:
4.5K
机构
引用论文
.png){kind=icon}
分享收藏分享收藏Autonomous agents modelling other agents: A comprehensive survey and open problems自治代理对其他代理进行建模: 全面调查和开放问题
OAAI
OAAI分享收藏Robust Multi-Agent Coordination via Evolutionary Generation of Auxiliary Adversarial Attackers通过进化生成辅助对抗攻击者的鲁棒多智能体协调
OAAI
OAAI分享收藏分享收藏
查看更多内容