arrow
Return

SecureBoost: A Lossless Federated Learning Framework

delete2021-11-01
delete230
delete
OA
AI
K
Kewei Cheng *
T
Tao Fan
Y
Yilun Jin
刘泳 cover
刘泳 (Yang Liu)
T
Tianjian Chen
D
Dimitrios Papadopoulos
Q
Qiang Yang
DOI:10.1109/MIS.2021.3082561delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
The protection of user privacy is an important concern in machine learning, as evidenced by the rolling out of the General Data Protection Regulation (GDPR) in the European Union (EU) in May 2018. The GDPR is designed to give users more control over their personal data, which motivates us to explore machine learning frameworks for data sharing that do not violate user privacy. To meet this goal, in this article, we propose a novel lossless privacy-preserving tree-boosting system known as SecureBoost in the setting of federated learning. SecureBoost first conducts entity alignment under a privacy-preserving protocol and then constructs boosting trees across multiple parties with a carefully designed encryption strategy. This federated learning system allows the learning process to be jointly conducted over multiple parties with common user samples but different feature sets, which corresponds to a vertically partitioned dataset. An advantage of SecureBoost is that it provides the same level of accuracy as the non -privacy-preserving approach while at the same time, reveals no information of each private data provider. We show that the SecureBoost framework is as accurate as other nonfederated gradient tree-boosting algorithms that require centralized data, and thus, it is highly scalable and practical for industrial applications such as credit risk analysis. To this end, we discuss information leakage during the protocol execution and propose ways to provably reduce it.
Keywords:
Data models
Machine learning
Collaborative work
Protocols
Data privacy
Servers
General Data Protection Regulation
Federated Learning
Privacy
Security
Decision Tree
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Intelligent Systems cover
IEEE Intelligent Systems
IF:
6.1
Papers:
1.6K
Citations:
4.5K

Organization

U
university of california los angeles
Scholars:
5.3W
Papers: 4.2W
Citations: 89
University of California System cover
University of California System
Scholars:
37.5W
Papers: 33.7W
Citations: 6.6K