arrow
Return

Improving adversarial robustness by learning shared information

delete2023-02-01
delete13
PRE
AI
X
Xi Yu
N
Niklas Smedemark-Margulies
T
Toshiaki Koike‐Akino
P
Pierre Moulin
M
Matthew Brand
K
Kieran Parsons
Y
Ye Wang *
DOI:10.1016/j.patcog.2022.109054delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
We consider the problem of improving the adversarial robustness of neural networks while retaining nat-ural accuracy. Motivated by the multi-view information bottleneck formalism, we seek to learn a repre-sentation that captures the shared information between clean samples and their corresponding adversar-ial samples while discarding these samples' view-specific information. We show that this approach leads to a novel multi-objective loss function, and we provide mathematical motivation for its components to-wards improving the robust vs. natural accuracy tradeoff. We demonstrate enhanced tradeoff compared to current state-of-the-art methods with extensive evaluation on various benchmark image datasets and architectures. Ablation studies indicate that learning shared representations is key to improving perfor-mance.(c) 2022 Elsevier Ltd. All rights reserved.
Keywords:
Adversarial robustness
Information bottleneck
Multi-view learning
Shared information

Journal

Pattern Recognition cover
Pattern Recognition
IF:
7.6
Papers:
1.3W
Citations:
4.5W

Organization

U
University of Florida
Scholars:
4.0W
Papers: 3.1W
Citations: 6.6W
T
tufts university
Scholars:
1.7W
Papers: 1.5W
Citations: 24
State University System of Florida cover
State University System of Florida
Scholars:
12.8W
Papers: 10.9W
Citations: 130
N
Northeastern University
Scholars:
2.5W
Papers: 1.6W
Citations: 3.0W
University of Illinois System cover
University of Illinois System
Scholars:
6.9W
Papers: 6.2W
Citations: 644
researcher View more organizations
Cited Papers

Cited Papers

Gradient-based learning applied to document recognition
err1998-01-01
err3.8W
PREAI
errLecun, Y; Bottou, L; Bengio, Y; Haffner, P
errShare
errSave
Modeling and validation of a piezoelectric actuator
err2006-11-29
err0
PREAI
errOriol Gomis-Bellmunt; Fayçal Ikhouane; Pere Castell-Vilanova; Joan Bergas-Jané
errShare
errSave
Clinical Studies of Iron Chelators in Malaria
err2009-02-17
err0
PREAI
errGeorge F. Mabeza; Godfrey Biemba; Victor R. Gordeuk
errShare
errSave
The complete genome sequence of the Gram-positive bacterium Bacillus subtilis
err1997-11-01
err0
errOAAI
errF. Kunst; N. Ogasawara; I. Moszer; A. M. Albertini; G. Alloni; V. Azevedo; M. G. Bertero; P. Bessières; A. Bolotin; S. Borchert; R. Borriss; L. Boursier; A. Brans; M. Braun; S. C. Brignell; S. Bron; S. Brouillet; C. V. Bruschi; B. Caldwell; V. Capuano; N. M. Carter; S.-K. Choi; J.-J. Codani; I. F. Connerton; N. J. Cummings; R. A. Daniel; F. Denizot; K. M. Devine; A. Düsterhöft; S. D. Ehrlich; P. T. Emmerson; K. D. Entian; J. Errington; C. Fabret; E. Ferrari; D. Foulger; C. Fritz; M. Fujita; Y. Fujita; S. Fuma; A. Galizzi; N. Galleron; S.-Y. Ghim; P. Glaser; A. Goffeau; E. J. Golightly; G. Grandi; G. Guiseppi; B. J. Guy; K. Haga; J. Haiech; C. R. Harwood; A. Hénaut; H. Hilbert; S. Holsappel; S. Hosono; M.-F. Hullo; M. Itaya; L. Jones; B. Joris; D. Karamata; Y. Kasahara; M. Klaerr-Blanchard; C. Klein; Y. Kobayashi; P. Koetter; G. Koningstein; S. Krogh; M. Kumano; K. Kurita; A. Lapidus; S. Lardinois; J. Lauber; V. Lazarevic; S.-M. Lee; A. Levine; H. Liu; S. Masuda; C. Mauël; C. Médigue; N. Medina; R. P. Mellado; M. Mizuno; D. Moestl; S. Nakai; M. Noback; D. Noone; M. O'Reilly; K. Ogawa; A. Ogiwara; B. Oudega; S.-H. Park; V. Parro; T. M. Pohl; D. Portetelle; S. Porwollik; A. M. Prescott; E. Presecan; P. Pujic; B. Purnelle; G. Rapoport; M. Rey; S. Reynolds; M. Rieger; C. Rivolta; E. Rocha; B. Roche; M. Rose; Y. Sadaie; T. Sato; E. Scanlan; S. Schleich; R. Schroeter; F. Scoffone; J. Sekiguchi; A. Sekowska; S. J. Seror; P. Serror; B.-S. Shin; B. Soldo; A. Sorokin; E. Tacconi; T. Takagi; H. Takahashi; K. Takemaru; M. Takeuchi; A. Tamakoshi; T. Tanaka; P. Terpstra; A. Tognoni; V. Tosato; S. Uchiyama; M. Vandenbol; F. Vannier; A. Vassarotti; A. Viari; R. Wambutt; E. Wedler; H. Wedler; T. Weitzenegger; P. Winters; A. Wipat; H. Yamamoto; K. Yamane; K. Yasumoto; K. Yata; K. Yoshida; H.-F. Yoshikawa; E. Zumstein; H. Yoshikawa; A. Danchin
errShare
errSave
errShare
errSave
no more