arrow
返回

Differentially private knowledge transfer for federated learning

delete2023-06-24
delete17
delete
OA
AI
T
Tao Qi
F
Fangzhao Wu *
C
Chuhan Wu
L
Liang He
Y
Yongfeng Huang *
X
Xing Xie
DOI:10.1038/s41467-023-38794-xdelete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Extracting useful knowledge from big data is important for machine learning. When data is privacy-sensitive and cannot be directly collected, federated learning is a promising option that extracts knowledge from decentralized data by learning and exchanging model parameters, rather than raw data. However, model parameters may encode not only non-private knowledge but also private information of local data, thereby transferring knowledge via model parameters is not privacy-secure. Here, we present a knowledge transfer method named PrivateKT, which uses actively selected small public data to transfer high-quality knowledge in federated learning with privacy guarantees. We verify PrivateKT on three different datasets, and results show that PrivateKT can maximally reduce 84% of the performance gap between centralized learning and existing federated learning methods under strict differential privacy restrictions. PrivateKT provides a potential direction to effective and privacy-preserving knowledge transfer in machine intelligent systems. To ensure the privacy of processed data, federated learning approaches involve local differential privacy techniques which however require communicating a large amount of data that needs protection. The authors propose here a framework that uses selected small data to transfer knowledge in federated learning with privacy guarantees.
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Nature Communications 封面图
Nature Communications
IF:
15.7
论文数:
9.3W
被引数:
91.2W

机构

T
tsinghua university
学者数:
11.9W
论文数: 10.0W
被引数: 137
M
Microsoft
学者数:
3.0K
论文数: 2.7K
被引数: 7
引用论文

引用论文

err分享
err收藏
err分享
err收藏
Machine learning reveals cryptic dialects that explain mate choice in a songbird
err2022-03-28
err22
errOAAI
errWang, Daiping; Forstmeier, Wolfgang; Farine, Damien R.; Maldonado-Chaparro, Adriana A.; Martin, Katrin; Pei, Yifan; Alarcon-Nieto, Gustavo; Klarevas-Irby, James A.; Ma, Shouwen; Aplin, Lucy M.; Kempenaers, Bart
err分享
err收藏
Advancing COVID-19 diagnosis with privacy-preserving collaboration in artificial intelligence
err2021-12-15
err37
errOAAI
errBai, Xiang; Wang, Hanchen; Ma, Liya; Xu, Yongchao; Gan, Jiefeng; Fan, Ziwei; Yang, Fan; Ma, Ke; Yang, Jiehua; Bai, Song; Shu, Chang; Zou, Xinyu; Huang, Renhao; Zhang, Changzheng; Liu, Xiaowu; Tu, Dandan; Xu, Chuou; Zhang, Wenqing; Wang, Xi; Chen, Anguo; Zeng, Yu; Yang, Dehua; Wang, Ming-Wei; Holalkere, Nagaraj; Halin, Neil J.; Kamel, Ihab R.; Wu, Jia; Peng, Xuehua; Wang, Xiang; Shao, Jianbo; Mongkolwat, Pattanasak; Zhang, Jianjun; Liu, Weiyang; Roberts, Michael; Teng, Zhongzhao; Beer, Lucian; Sanchez, Lorena E.; Sala, Evis; Rubin, Daniel L.; Weller, Adrian; Lasenby, Joan; Zheng, Chuangsheng; Wang, Jianming; Li, Zhen; Schonlieb, Carola; Xia, Tian
err分享
err收藏
Stratification of hospitalized COVID-19 patients into clinical severity progression groups by immuno-phenotyping and machine learning
err2022-02-17
err35
errOAAI
errMueller, Yvonne M.; Schrama, Thijs J.; Ruijten, Rik; Schreurs, Marco W. J.; Grashof, Dwin G. B.; van de Werken, Harmen J. G.; Lasinio, Giovanna Jona; Alvarez-Sierra, Daniel; Kiernan, Caoimhe H.; Eiro, Melisa D. Castro; van Meurs, Marjan; Brouwers-Haspels, Inge; Zhao, Manzhi; Li, Ling; de Wit, Harm; Ouzounis, Christos A.; Wilmsen, Merel E. P.; Alofs, Tessa M.; Laport, Danique A.; van Wees, Tamara; Kraker, Geoffrey; Jaimes, Maria C.; Van Bockstael, Sebastiaan; Hernandez-Gonzalez, Manuel; Rokx, Casper; Rijnders, Bart J. A.; Pujol-Borrell, Ricardo; Katsikis, Peter D.
err分享
err收藏
err分享
err收藏
学者 查看更多内容