arrow
返回

A Federated Learning Framework Based on Differentially Private Continuous Data Release

delete2024-09-01
delete3
PRE
AI
J
Jianping Cai
X
Ximeng Liu *
Q
Qingqing Ye
刘泳 封面图
刘泳 (Yang Liu)
Y
Yuyang Wang
DOI:10.1109/TDSC.2024.3364060delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Federated learning (FL) provides a learning framework without participants sharing local raw data, but individual privacy is still at risk of disclosure through attacking the trained models. Due to the strong privacy guarantee, differential privacy (DP) is widely applied to FL to avoid privacy leakage. Traditional private learning adds noise directly to the gradients. The continuous accumulated noise on parameter models severely impairs learning effectiveness. To solve this problem, we introduce the idea of differentially private continuous data release (DPCR) into FL and propose an FL framework based on DPCR (FL-DPCR). Meanwhile, our proposed Equivalent Aggregation Theorem demonstrates that DPCR effectively reduces the overall error added to parameter models and improves FL's accuracy. To improve FL-DPCR's learning effectiveness, we introduce Matrix Mechanism to construct a release strategy and design a binary-indexed-tree (BIT) based DPCR model for Gaussian mechanism (BCRG). By solving a complex nonlinear programming problem with negative exponents, BCRG achieves optimal release accuracy efficiently. Besides, we exploit the residual privacy budget to boost the accuracy further and propose an advanced BCRG version (ABCRG). Our experiments show that, compared to traditional FL with DP, our achievements improve the accuracy with gains ranging from 3.4% on FMNIST to 65.7% on PAMAP2.
Keyword:
Privacy
Data models
Artificial intelligence
Differential privacy
Biomedical imaging
Computational modeling
Security
Federated learning
differential privacy
continuous data release
binary indexed tree
matrix mechanism

期刊

IEEE Transactions on Dependable and Secure Computing 封面图
IEEE Transactions on Dependable and Secure Computing
IF:
7.5
论文数:
2.5K
被引数:
9.6K

机构

H
hong kong polytechnic university
学者数:
3.0W
论文数: 4.1W
被引数: 921
T
tsinghua university
学者数:
11.9W
论文数: 10.0W
被引数: 137
F
fuzhou university
学者数:
3.3W
论文数: 2.1W
被引数: 31
学者 查看更多机构
引用论文

引用论文

Nuclear migration advances in fungi
err1995-07-01
err0
PREAI
errN. Ronald Morris; Xin Xiang; Susan M. Beckwith
err分享
err收藏
Towards a wireless and fully-implantable ECoG system
err2013-06-01
err0
PREAI
errE. Tolstosheeva; J. Hoeffmann; J. Pistor; D. Rotermund; T. Schellenberg; D. Boll; T. Hertzberg; V. Gordillo-Gonzalez; S. Mandon; D. Peters-Drolshagen; M. Schneider; K. Pawelzik; A. Kreiter; S. Paul; W. Lang
err分享
err收藏
Federated learning in medicine: facilitating multi-institutional collaborations without sharing patient data医学联合学习: 在不共享患者数据的情况下促进多机构合作
err2020-07-28
err631
errOAAI
errSheller, Micah J.; Edwards, Brandon; Reina, G. Anthony; Martin, Jason; Pati, Sarthak; Kotrotsou, Aikaterini; Milchenko, Mikhail; Xu, Weilin; Marcus, Daniel; Colen, Rivka R.; Bakas, Spyridon
err分享
err收藏
学者 查看更多内容