arrow
Return

Privacy-Preserving Collaborative Learning Through Feature Extraction

delete2024-01-01
delete2
delete
OA
AI
A
Alireza Sarmadi *
H
Hao Fu
P
P. Krishnamurthy
S
Siddharth Garg
F
Farshad Khorrami
DOI:10.1109/TDSC.2023.3263507delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
We propose a framework in which multiple entities collaborate to build a machine learning model while preserving privacy of their data. The approach utilizes feature embeddings from shared/per-entity feature extractors transforming data into a feature space for cooperation between entities. We propose two specific methods and compare them with a baseline method. In Shared Feature Extractor (SFE) Learning, the entities use a shared feature extractor to compute feature embeddings of samples. In Locally Trained Feature Extractor (LTFE) Learning, each entity uses a separate feature extractor, and models are trained using concatenated features from all entities. As a baseline, in Cooperatively Trained Feature Extractor (CTFE) Learning, the entities train models by sharing raw data. Secure multi-party algorithms are utilized to train models without revealing data or features in plain text. We investigate the trade-offs among SFE, LTFE, and CTFE in regard to performance, privacy leakage (using an off-the-shelf membership inference attack), and computational cost. LTFE provides the most privacy, followed by SFE, and then CTFE. Computational cost is lowest for SFE and the relative speed of CTFE and LTFE depends on network architecture. CTFE and LTFE provide the best accuracy. We use three different datasets for evaluations.
Keywords:
Feature extraction
Cryptography
Training
Servers
Computational modeling
Protocols
Data models
Collaborative learning
privacy-preserving training
secure multiparty computation
neural networks
feature extractor

Journal

IEEE Transactions on Dependable and Secure Computing cover
IEEE Transactions on Dependable and Secure Computing
IF:
7.5
Papers:
2.6K
Citations:
9.6K

Organization

N
New York University
Scholars:
4.4W
Papers: 3.9W
Citations: 5.8W
Cited Papers

Cited Papers

Inductive Power System for Autonomous Underwater Vehicles
err2007-09-01
err0
PREAI
errTim McGinnis; Christopher P. Henze; Karl Conroy
errShare
errSave
Multi-key privacy-preserving deep learning in cloud computing
err2017-09-01
err359
PREAI
errLi, Ping; Li, Jin; Huang, Zhengan; Li, Tong; Gao, Chong-Zhi; Yiu, Siu-Ming; Chen, Kai
errShare
errSave
Agreement in the diagnosis of dental fluorosis in central incisors performed by a standardized photographic method and clinical examination
err2009-05-01
err0
errOAAI
errCarolina Castro Martins; Loliza Chalub; Ynara Bosco Lima-Arsati; Isabela Almeida Pordeus; Saul Martins Paiva
errShare
errSave
Beyond reach: Do symmetric changes in motor costs affect decision making? A registered report
err2023-01-01
err0
errOAAI
errArkady Zgonnikov; Nadim A. A. Atiya; Denis O’Hora; Iñaki Rañò; KongFatt Wong-Lin
errShare
errSave
researcher View more