arrow
Return

Approximated Coded Computing: Towards Fast, Private and Secure Distributed Machine Learning

delete
delete0
PRE
AI
H
Houming Qiu
朱琨 (Kun Zhu)
N
Nguyen Cong Luong
D
Dusit Niyato
DOI:10.1109/TETC.2025.3562192delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In a large-scale distributed machine learning system, coded computing has attracted wide-spread attention since it can effectively alleviate the impact of stragglers. However, several emerging problems greatly limit the performance of coded distributed systems. First, an existence of colluding workers who collude results with each other leads to serious privacy leakage issues. Second, there are few existing works considering security issues in data transmission of distributed computing systems/or coded distributed machine learning systems. Third, the number of required results for which need to wait increases with the degree of decoding functions. In this article, we design a secure and private approximated coded distributed computing (SPACDC) scheme that deals with the above-mentioned problems simultaneously. Our SPACDC scheme guarantees data security during the transmission process using a new encryption algorithm based on elliptic curve cryptography. Especially, the SPACDC scheme does not impose strict constraints on the minimum number of results required to be waited for. An extensive performance analysis is conducted to demonstrate the effectiveness of our SPACDC scheme. Furthermore, we present a secure and private distributed learning algorithm based on the SPACDC scheme, which can provide information-theoretic privacy protection for training data. Our experiments show that the SPACDC-based deep learning algorithm achieves a significant speedup over the baseline approaches.
Keywords:
Coded computing
distributed machine learning
elliptic curve cryptography
security
privacy
recovery threshold
stragglers

Journal

IEEE Transactions on Emerging Topics in Computing cover
IEEE Transactions on Emerging Topics in Computing
IF:
5.4
Papers:
1.1K
Citations:
3.4K

Organization

J
Jiangxi University of Finance and Economics
Scholars:
677
Papers: 434
Citations: 2.2K
N
Nanyang Technological University
Scholars:
4.9W
Papers: 4.8W
Citations: 8.1W
P
Phenikaa University
Scholars:
254
Papers: 130
Citations: 998
N
Nanjing University of Aeronautics and Astronautics
Scholars:
7.4K
Papers: 3.1K
Citations: 2.4W
researcher View more organizations