arrow
Return

Distributed Multiagent Coordinated Learning for Autonomous Driving in Highways Based on Dynamic Coordination Graphs

delete2020-02-01
delete82
PRE
AI
C
Chao Yu
王新 cover
王新 (Xin Wang)
徐鑫 cover
徐鑫 (Xin Xu)
M
Minjie Zhang
葛宏伟 (Hongwei Ge) *
任健康 cover
任健康 (Jiankang Ren)
L
Liang Sun
B
Bingcai Chen
谭国真 (Guozhen Tan)
DOI:10.1109/TITS.2019.2893683delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Autonomous driving is one of the most important AI applications and has attracted extensive interest in recent years. A large number of studies have successfully applied reinforcement learning techniques in various aspects of autonomous driving, ranging from low-level control of driving maneuvers to higher level of strategic decision-making. However, comparatively less progress has been made in investigating how co-existing autonomous vehicles would interact with each other in a common environment and how reinforcement learning can be helpful in such situations by applying multiagent reinforcement learning techniques in the high-level strategic decision-making of the following or overtaking for a group of autonomous vehicles in highway scenarios. Learning to achieve coordination among vehicles in such situations is challenging due to the unique feature of vehicular mobility, which renders it infeasible to directly apply the existing coordinated learning approaches. To solve this problem, we propose using dynamic coordination graph to model the continuously changing topology during vehicles' interactions and come up with two basic learning approaches to coordinate the driving maneuvers for a group of vehicles. Several extension mechanisms are then presented to make these approaches workable in a more complex and realistic setting with any number of vehicles. The experimental evaluation has verified the benefits of the proposed coordinated learning approaches, compared with other approaches that learn without coordination or rely on some traditional mobility models based on some expert driving rules.
Keywords:
Autonomous vehicles
Vehicle dynamics
Decision making
Reinforcement learning
Topology
Road transportation
Germanium
Reinforcement learning
autonomous driving
coordination
coordination graph
multiagent learning
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Intelligent Transportation Systems cover
IEEE Transactions on Intelligent Transportation Systems
IF:
8.4
Papers:
9.5K
Citations:
6.3W

Organization

U
University of Wollongong
Scholars:
1.3W
Papers: 1.6W
Citations: 2.8W
D
Dalian University of Technology
Scholars:
5.9W
Papers: 4.4W
Citations: 5.5W
N
national university of defense technology - china
Scholars:
1.8W
Papers: 1.4W
Citations: 9
researcher View more organizations