arrow
Return

Approximated Coded Computing: Towards Fast, Private and Secure Distributed Machine Learning

delete
delete0
PRE
AI
H
Houming Qiu
朱
朱琨 (Kun Zhu)
N
Nguyen Cong Luong
D
Dusit Niyato
DOI:10.1109/TETC.2025.3562192delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In a large-scale distributed machine learning system, coded computing has attracted wide-spread attention since it can effectively alleviate the impact of stragglers. However, several emerging problems greatly limit the performance of coded distributed systems. First, an existence of colluding workers who collude results with each other leads to serious privacy leakage issues. Second, there are few existing works considering security issues in data transmission of distributed computing systems/or coded distributed machine learning systems. Third, the number of required results for which need to wait increases with the degree of decoding functions. In this article, we design a secure and private approximated coded distributed computing (SPACDC) scheme that deals with the above-mentioned problems simultaneously. Our SPACDC scheme guarantees data security during the transmission process using a new encryption algorithm based on elliptic curve cryptography. Especially, the SPACDC scheme does not impose strict constraints on the minimum number of results required to be waited for. An extensive performance analysis is conducted to demonstrate the effectiveness of our SPACDC scheme. Furthermore, we present a secure and private distributed learning algorithm based on the SPACDC scheme, which can provide information-theoretic privacy protection for training data. Our experiments show that the SPACDC-based deep learning algorithm achieves a significant speedup over the baseline approaches.
Keywords:
Coded computing
distributed machine learning
elliptic curve cryptography
security
privacy
recovery threshold
stragglers

Journal

IEEE Transactions on Emerging Topics in Computing cover
IEEE Transactions on Emerging Topics in Computing
IF:
5.4
Papers:
1.1K
Citations:
3.4K

Organization

J
Jiangxi University of Finance and Economics
Scholars:
728
Papers: 464
Citations: 2.2K
N
Nanyang Technological University
Scholars:
4.9W
Papers: 4.8W
Citations: 8.1W
P
Phenikaa University
Scholars:
254
Papers: 130
Citations: 998
N
Nanjing University of Aeronautics and Astronautics
Scholars:
7.4K
Papers: 3.1K
Citations: 2.4W
researcher View more organizations
Cited Papers

Cited Papers

Speeding Up Distributed Machine Learning Using Codes
err2018-03-01
err0
errOAAI
errKangwook Lee; Maximilian Lam; Ramtin Pedarsani; Dimitris Papailiopoulos; Kannan Ramchandran
errShare
errSave
PICASSO: Unleashing the Potential of GPU-centric Training for Wide-and-deep Recommender Systems
err2022-05-01
err0
errOAAI
errYuanxing Zhang; Langshi Chen; Siran Yang; Man Yuan; Huimin Yi; Jie Zhang; Jiamang Wang; Jianbo Dong; Yunlong Xu; Yue Song; Yong Li; Di Zhang; Wei Lin; Lin Qu; Bo Zheng
errShare
errSave
Coded Computing for Multi-Cluster Distributed Computations
err2025-02-01
err0
PREAI
errWu,Youlong; Li,Chenglin; Hu,Haoyang; Song,Xiyu; Ma,Shuai; Shi,Yuanming
errShare
errSave
errShare
errSave
On the Optimal Recovery Threshold of Coded Matrix Multiplication
err2020-01-01
err0
errOAAI
errSanghamitra Dutta; Mohammad Fahim; Farzin Haddadpour; Haewon Jeong; Viveck Cadambe; Pulkit Grover
errShare
errSave
Self-Supervised Learning for Recommender Systems: A Survey
err2024-01-01
err75
errOAAI
errYu, Junliang; Yin, Hongzhi; Xia, Xin; Chen, Tong; Li, Jundong; Huang, Zi
errShare
errSave
researcher View more