arrow
返回

Stealthy Backdoors as Compression Artifacts

delete2022-01-01
delete11
delete
OA
AI
Y
Yulong Tian
F
Fnu Suya
F
Fengyuan Xu
D
David Evans *
DOI:10.1109/TIFS.2022.3160359delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Model compression is a widely-used approach for reducing the size of deep learning models without much accuracy loss, enabling resource-hungry models to be compressed for use on resource-constrained devices. In this paper, we study the risk that model compression could provide an opportunity for adversaries to inject stealthy backdoors. In a backdoor attack on a machine learning model, an adversary produces a model that performs well on normal inputs but outputs targeted misclassifications on inputs containing a small trigger pattern. We design stealthy backdoor attacks such that the full-sized model released by adversaries appears to be free from backdoors (even when tested using state-of-the-art techniques), but when the model is compressed it exhibits a highly effective backdoor. We show this can be done for two common model compression techniques-model pruning and model quantization-even in settings where the adversary has limited knowledge of how the particular compression will be done. Our findings demonstrate the importance of performing security tests on the models that will actually be deployed not in their precompressed version. Our implementation is available at https://github.com/yulongtzzz/Stealthy-Backdoors-as-Compression-Artifacts.
Keyword:
Computational modeling
Quantization (signal)
Security
Numerical models
Deep learning
Data models
Training
Deep learning
neural network compression
backdoor attack

期刊

IEEE Transactions on Information Forensics and Security 封面图
IEEE Transactions on Information Forensics and Security
IF:
8
论文数:
5.2K
被引数:
2.3W

机构

U
University of Virginia
学者数:
3.0W
论文数: 2.7W
被引数: 4.1W
N
nanjing university
学者数:
7.8W
论文数: 5.6W
被引数: 87
引用论文

引用论文

err分享
err收藏
Calcium-modulating cyclophilin ligand regulates membrane trafficking of postsynaptic GABAA receptors
err2008-06-01
err0
errOAAI
errXu Yuan; Jun Yao; David Norris; David D. Tran; Richard J. Bram; Gong Chen; Bernhard Luscher
err分享
err收藏
Monitoring of Water Transportation in Plant Stem With Microneedle Sap Flow Sensor
err2018-06-01
err0
PREAI
errSangwoong Baek; Eunyong Jeon; Kyoung Sub Park; Kyung-Hwan Yeo; Junghoon Lee
err分享
err收藏
err分享
err收藏
DPP9 directly sequesters the NLRP1 C-terminus to repress inflammasome activation
err
IF0
err2020-08-14
err0
errOAAI
errL. Robert Hollingsworth; Humayun Sharif; Andrew R. Griswold; Pietro Fontana; Julian Mintseris; Kevin B. Dagbay; Joao A. Paulo; Steven P. Gygi; Daniel A. Bachovchin; Hao Wu
err分享
err收藏
Expression of hirudin in fed-batch cultures of recombinantSaccharomyces cerevisiae
err1994-07-01
err0
PREAI
errDong-Hoon Lee; Jin-Byung Park; Jin-Ho Seo; Eui-Sung Choi; Sang-Ki Lee
err分享
err收藏
学者 查看更多内容