arrow
返回

Reinforcement Learning-Based Personalized Differentially Private Federated Learning

delete2025-01-01
delete0
PRE
AI
X
Xiaozhen Lu *
Z
Zihan Liu
肖亮 封面图
肖亮 (Liang Xiao)
H
Huaiyu Dai
DOI:10.1109/TIFS.2024.3515814delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Due to the different privacy and local model quality requirements for each participant, federated learning (FL) is vulnerable to membership inference attacks. To solve this issue, we propose a risk-aware reinforcement learning (RL)-based personalized differentially private FL framework. This framework uses local model accuracy and privacy loss as the constraints to satisfy the user's personalized requirements. By designing a multi-agent RL, this framework optimizes perturbation policy including perturbation mechanisms and parameters (such as privacy budget and probabilistic relaxation). The goal of each participant is to improve global accuracy and reduce privacy loss, attack success rate, and short-term risk value. Firstly, the framework designs a two-level hierarchical policy selection module to choose the perturbation policy to accelerate learning speed. Secondly, our proposed framework designs a punishment function to evaluate short-term risk and an R-network to estimate long-term risk, which guarantees safe exploration. Thirdly, this framework formulates an improved Boltzmann policy distribution to increase the impact of risk, thus avoiding risky policies that may cause severe privacy leakage or local task failure. We also analyze the convergence performance and provide privacy analysis for both Gaussian and Laplace mechanisms. Experimental results based on the MNIST dataset demonstrate the effectiveness of our framework compared with benchmarks.
Keyword:
Federated learning
local differential privacy
personalized privacy
personalized privacy
reinforcement learning
reinforcement learning
safe exploration
safe exploration
safe exploration

期刊

IEEE Transactions on Information Forensics and Security 封面图
IEEE Transactions on Information Forensics and Security
IF:
8
论文数:
5.3K
被引数:
2.3W

机构

X
xiamen university
学者数:
5.9W
论文数: 3.8W
被引数: 67
N
North Carolina State University
学者数:
2.6W
论文数: 2.3W
被引数: 3.7W
引用论文

引用论文

err分享
err收藏
Local Differential Private Data Aggregation for Discrete Distribution Estimation
err2019-09-01
err57
PREAI
errWang, Shaowei; Huang, Liusheng; Nie, Yiwen; Zhang, Xinyuan; Wang, Pengzhan; Xu, Hongli; Yang, Wei
err分享
err收藏
Robust Transparency Against Model Inversion Attacks
err2020-01-01
err11
errOAAI
errAlufaisan, Yasmeen; Kantarcioglu, Murat; Zhou, Yan
err分享
err收藏
err分享
err收藏
学者 查看更多内容