1
Return

Learn a Robust Policy for Real-World Driving With Adversarial Reinforcement Learning

delete2026-02-24
delete0
PRE
AI
Y
Yangang Ren
G
Guojian Zhan
S
Shengbo Eben Li
J
Jingliang Duan
Y
Yao Lyu
Y
Yang Guan
K
Keqiang Li
DOI:10.1109/TIV.2026.3667572delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Reinforcement learning (RL) has emerged as a promising approach for achieving high-level autonomous driving as its self-evolving ability without reliance on human rules. Although RL-driven methods have yielded fruitful demonstrations in driving domain, most of them are trained and validated only on simulation platforms. Due to the inherent difference between simulation and reality, the driving policy usually performs poorly when applied to a realistic environment. In this paper, we propose an adversarial training framework for driving policy to enhance practical performance, which introduces the adversarial policy to simulate the discrepancy of environments during training and incorporates the collected data from the real world to provide the discrepancy bound. Besides, the adversarial policy is iteratively updated with gradient-based optimization, which enables the automatic generation of diversified discrepancies for different traffic participants. The action projection is developed to ensure that the output of adversary satisfies the discrepancy bound given by data, so as to prevent an aggressive adversary making the overly conservative policy. We evaluate the trained policy on a fully sized vehicle at an urban intersection with mixed traffic flows. Results indicate that our driving policy can handle unseen behaviors of traffic actors meanwhile realizing the safe and smooth control for the automated vehicle. Our work provides a feasible solution for RL implementation in the field of real-world autonomous driving.
Keywords:
Automated vehicle
reinforcement learning
real-world driving
constraint optimization

Journal

I
IEEE Transactions on Intelligent Vehicles
IF:
14.3
Papers:
1.2K
Citations:
1.2W

Organization

T
tsinghua university
Scholars:
11.5W
Papers: 9.9W
Citations: 137
U
university of science and technology beijing
Scholars:
1.1W
Papers: 4.0K
Citations: 2
Cited Papers

Cited Papers

Citing Papers

Citing Papers