返回
Multi-Task Federated Split Learning Across Multi-Modal Data with Privacy Preservation
DOI:10.3390/s25010233.png)
摘要
En 中文
With the advancement of federated learning (FL), there is a growing demand for schemes that support multi-task learning on multi-modal data while ensuring robust privacy protection, especially in applications like intelligent connected vehicles. Traditional FL schemes often struggle with the complexities introduced by multi-modal data and diverse task requirements, such as increased communication overhead and computational burdens. In this paper, we propose a novel privacy-preserving scheme for multi-task federated split learning across multi-modal data (MTFSLaMM). Our approach leverages the principles of split learning to partition models between clients and servers, employing a modular design that reduces computational demands on resource-constrained clients. To ensure data privacy, we integrate differential privacy to protect intermediate data and employ homomorphic encryption to safeguard client models. Additionally, our scheme employs an optimized attention mechanism guided by mutual information to achieve efficient multi-modal data fusion, maximizing information integration while minimizing computational overhead and preventing overfitting. Experimental results demonstrate the effectiveness of the proposed scheme in addressing the challenges of multi-modal data and multi-task learning while offering robust privacy protection, with MTFSLaMM achieving a 15.3% improvement in BLEU-4 and an 11.8% improvement in CIDEr scores compared with the baseline.
Keyword:
federated learning
multi-task learning
data privacy
split learning
multi-modal data
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
3.5
论文数:
7.2W
被引数:
20.9W
机构
引用论文
Sur la structure des diesters de tréhalose (“cord factors”) produits par Nocardia asteroides et Nocardia rhodochrous关于由诺卡氏菌属(Nocardia asteroides)和诺卡氏菌属(Nocardia rhodochrous)产生的海藻糖二酯("cord factors")的结构
Impact of Recipient Statin Treatment on Graft-versus-Host Disease after Allogeneic Hematopoietic Cell Transplantation受者他汀类药物治疗对异基因造血干细胞移植后移植物抗宿主病的影响

