arrow
Return

DGGI: Deep Generative Gradient Inversion with diffusion model

delete2025-01-01
delete0
PRE
AI
L
Liwen Wu
Z
Zhizhi Liu
B
Bin Pu *
K
Kang Wei
H
Hangcheng Cao
S
Shaowen Yao
DOI:10.1016/j.inffus.2024.102620delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Federated learning is a privacy-preserving distributed framework that facilitates information fusion and sharing among different clients, enabling the training of a global model without exposing raw data. However, the gradient inversion attack that can reconstruct the training data via gradients has posed a significant threat. Prior attack approaches have demonstrated the efficacy of gradient inversion on low-resolution datasets with small batch sizes, which is impractical in real scenarios. To tackle this issue, this paper proposes an innovative and practical gradient inversion method, namely Deep Generative Gradient Inversion (DGGI), which employs the prior knowledge of diffusion models to enhance reconstruction performance on high-resolution datasets and larger batch sizes. Furthermore, a novel group consistency regularization term that constrains the distance between reconstruction and alignment images has been developed to address the issue of spatial variations caused by pre-trained diffusion model. Experiments conducted on both natural and medical image datasets demonstrate that our DGGI method outperforms state-of-the-art baselines in image reconstruction metrics. Furthermore, our approach achieves pixel-level reconstruction and causes leakage of privacy information, even at larger batch sizes or under various defenses, which can aid in the exploration of latent security concerns within information fusion models.
Keywords:
Gradient inversion
Computer privacy
Information security
Network security
Client data fusion

Journal

Information Fusion cover
Information Fusion
IF:
15.5
Papers:
4.2K
Citations:
2.7W

Organization

Y
Yunnan University
Scholars:
1.6W
Papers: 9.9K
Citations: 13
H
hunan university
Scholars:
4.5W
Papers: 3.3W
Citations: 70
Cited Papers

Cited Papers

Low dose CT image and projection dataset
err2020-12-16
err143
errOAAI
errMoen, Taylor R.; Chen, Baiyu; Holmes, David R., III; Duan, Xinhui; Yu, Zhicong; Yu, Lifeng; Leng, Shuai; Fletcher, Joel G.; McCollough, Cynthia H.
errShare
errSave
Diff-IF: Multi-modality image fusion via diffusion model with fusion knowledge prior
err2024-10-01
err6
PREAI
errYi, Xunpeng; Tang, Linfeng; Zhang, Hao; Xu, Han; Ma, Jiayi
errShare
errSave
Variation-Aware Federated Learning With Multi-Source Decentralized Medical Image Data
err2021-07-01
err75
PREAI
errYan, Zengqiang; Wicaksana, Jeffry; Wang, Zhiwei; Yang, Xin; Cheng, Kwang-Ting
errShare
errSave
E2EGI: End-to-End Gradient Inversion in Federated Learning
err2023-02-01
err6
PREAI
errLi, Zhaohua; Wang, L.; Chen, Guangyao; Zhang, Zhiqiang; Shafiq, Muhammad; Gu, Zhaoquan
errShare
errSave
Survey on federated learning threats: Concepts, taxonomy on attacks and defences, experimental study and challenges
err2023-02-01
err98
errOAAI
errRodriguez-Barroso, Nuria; Jimenez-Lopez, Daniel; Victoria Luzon, M.; Herrera, Francisco; Martinez-Camara, Eugenio
errShare
errSave
Score-based diffusion models for accelerated MRI
err2022-08-01
err137
errOAAI
errChung, Hyungjin; Ye, Jong Chul
errShare
errSave
Generative Adversarial Networks An overview
err2018-01-01
err2.4K
errOAAI
errCreswell, Antonia; White, Tom; Dumoulin, Vincent; Arulkumaran, Kai; Sengupta, Biswa; Bharath, Anil A.
errShare
errSave
DPFLA: Defending Private Federated Learning Against Poisoning Attacks
err2024-07-01
err4
PREAI
errFeng, Xia; Cheng, Wenhao; Cao, Chunjie; Wang, Liangmin; Sheng, Victor S.
errShare
errSave
Diffusion model with disentangled modulations for sharpening multispectral and hyperspectral images
err2024-04-01
err20
PREAI
errCao, Zihan; Cao, Shiqi; Deng, Liang-Jian; Wu, Xiao; Hou, Junming; Vivone, Gemine
errShare
errSave
researcher View more