arrow
Return

Adversarial Differentiable Data Augmentation for Autonomous Systems

delete2021-05-30
delete8
PRE
AI
M
Manli Shu *
沈煜 cover
沈煜 (Yu Shen)
M
Ming C. Lin
T
Tom Goldstein
DOI:10.1109/ICRA48506.2021.9561205delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Autonomous systems often rely on neural networks to achieve high performance on planning and control problems. Unfortunately, neural networks suffer severely when input images become degraded in ways that are not reflected in the training data. This is particularly problematic for robotic systems like autonomous vehicles (AV) for which reliability is paramount. In this work, we consider robust optimization methods for hardening control systems against image corruptions and other unexpected domain shifts. Recent work on robust optimization for neural nets has been focused largely on combating adversarial attacks. In this work, we borrow ideas from the adversarial training and data augmentation literature to enhance robustness to image corruptions and domain shifts. To this end, we train networks while augmenting image data with a battery of image degradations. Unlike traditional augmentation methods, we choose the parameters for each degradation adversarially so as to maximize system performance. By formulating image degradations in a way that is differentiable with respect to degradation parameters, we enable the use of efficient optimization methods (PGD) for choosing worst-case augmentation parameters. We demonstrate the efficacy of this method on the learning to steer task for AVs. By adversarially training against image corruptions, we produce networks that are highly robust to image corruptions. We show that the proposed differentiable augmentation schemes result in higher levels of robustness and accuracy for a range of settings as compared to baseline and state-of-the-art augmentation methods.

Journal

I
IEEE International Conference on Robotics and Automation
IF:
0
Papers:
33
Citations:
0

Organization

University System of Maryland cover
University System of Maryland
Scholars:
6.5W
Papers: 5.6W
Citations: 113
Cited Papers

Cited Papers

Role of interferon-γ in Vα14+ natural killer T cell-mediated host defense against Streptococcus pneumoniae infection in murine lungs
err2007-03-01
err0
PREAI
errMasashi Nakamatsu; Natsuo Yamamoto; Masumitsu Hatta; Chikara Nakasone; Takeshi Kinjo; Kazuya Miyagi; Kaori Uezu; Kiwamu Nakamura; Toshinori Nakayama; Masaru Taniguchi; Yoichiro Iwakura; Mitsuo Kaku; Jiro Fujita; Kazuyoshi Kawakami
errShare
errSave
Learn to Steer through Deep Reinforcement Learning
errSENSORS
IF3.5
err2018-10-27
err29
errOAAI
errWu, Keyu; Esfahani, Mahdi Abolfazli; Yuan, Shenghai; Wang, Han
errShare
errSave
Stability of adaptive behaviors in middle-school children with autism spectrum disorders
err2007-10-01
err0
PREAI
errRobin L. Gabriels; Bonnie Jean Ivers; Dina E. Hill; John A. Agnew; John McNeill
errShare
errSave
errShare
errSave
Impaired liver regeneration is associated with reduced cyclin B1 in natural killer T cell-deficient mice
err2017-03-23
err0
errOAAI
errAmi Ben Ya’acov; Hadar Meir; Lydia Zolotaryova; Yaron Ilan; Eyal Shteyer
errShare
errSave
Restored Circulating Invariant NKT Cells Are Associated with Viral Control in Patients with Chronic Hepatitis B
err2011-12-16
err0
errOAAI
errXiaotao Jiang; Mingxia Zhang; Qintao Lai; Xuan Huang; Yongyin Li; Jian Sun; William G.H. Abbott; Shiwu Ma; Jinlin Hou
errShare
errSave
The role of natural killer T cells in a mouse model with spontaneous bile duct inflammation
err2017-02-20
err0
errOAAI
errElisabeth Schrumpf; Xiaojun Jiang; Sebastian Zeissig; Marion J. Pollheimer; Jarl Andreas Anmarkrud; Corey Tan; Mark A. Exley; Tom H. Karlsen; Richard S. Blumberg; Espen Melum
errShare
errSave
Interferon alpha treatment stimulates interferon gamma expression in type I NKT cells and enhances their antiviral effect against hepatitis C virus
err2017-03-02
err0
errOAAI
errEisuke Miyaki; Nobuhiko Hiraga; Michio Imamura; Takuro Uchida; Hiromi Kan; Masataka Tsuge; Hiromi Abe-Chayama; C. Nelson Hayes; Grace Naswa Makokha; Masahiro Serikawa; Hiroshi Aikata; Hidenori Ochi; Yuji Ishida; Chise Tateno; Hideki Ohdan; Kazuaki Chayama
errShare
errSave
researcher View more