.png){kind=icon}
Return
Gradient Leakage Attack Resilient Deep Learning
.png){kind=icon}
OA
AI
DOI：10.1109/TIFS.2021.3139777.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Gradient leakage attacks are considered one of the wickedest privacy threats in deep learning as attackers covertly spy gradient updates during iterative training without compromising model training quality, and yet secretly reconstruct sensitive training data using leaked gradients with high attack success rate. Although deep learning with differential privacy is a defacto standard for publishing deep learning models with differential privacy guarantee, we show that differentially private algorithms with fixed privacy parameters are vulnerable against gradient leakage attacks. This paper investigates alternative approaches to gradient leakage resilient deep learning with differential privacy (DP). First, we analyze existing implementation of deep learning with differential privacy, which use fixed noise variance to injects constant noise to the gradients in all layers using fixed privacy parameters. Despite the DP guarantee provided, the method suffers from low accuracy and is vulnerable to gradient leakage attacks. Second, we present a gradient leakage resilient deep learning approach with differential privacy guarantee by using dynamic privacy parameters. Unlike fixed-parameter strategies that result in constant noise variance, different dynamic parameter strategies present alternative techniques to introduce adaptive noise variance and adaptive noise injection which are closely aligned to the trend of gradient updates during differentially private model training. Finally, we describe four complementary metrics to evaluate and compare alternative approaches. Extensive experiments on six benchmark datasets show that differentially private deep learning with dynamic privacy parameters outperforms the deep learning using fixed DP parameters, and existing adaptive clipping approaches in all aspects: compelling accuracy performance, strong differential privacy guarantee, and high attack resilience.
Keywords:
Deep learning
gradient leakage attack
differential privacy
Journal
IF:
8
Papers:
5.3K
Citations:
2.3W
Organization
Cited Papers
The relationship of monodentate and bidentate coordinated uranium(VI) sulfate in aqueous solution
PREAI
ShareSaveParkinson's disease: Nigral receptor changes support peptidergic role in nigrostriatal modulation
PREAI
ShareSaveShareSaveShareSaveShareSaveShareSaveIdentification of Small Molecules that Disrupt Signaling between ABL and Its Positive Regulator RIN1.png)
PLOS ONE
OAAI
PLOS ONEIF0
OAAIShareSave
View more