.png){kind=icon}
返回
A Unified Multi-Task Semantic Communication System for Multimodal Data
.png){kind=icon}
OA
AI
DOI：10.1109/TCOMM.2024.3364990.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Task-oriented semantic communications have achieved significant performance gains. However, the employed deep neural networks in semantic communications have to be updated when the task is changed or multiple models need to be stored for performing different tasks. To address this issue, we develop a unified deep learning-enabled semantic communication system (U-DeepSC), where a unified end-to-end framework can serve many different tasks with multiple modalities of data. As the number of required features varies from task to task, we propose a vector-wise dynamic scheme that can adjust the number of transmitted symbols for different tasks. Moreover, our dynamic scheme can also adaptively adjust the number of transmitted features under different channel conditions to optimize the transmission efficiency. Particularly, we devise a lightweight feature selection module (FSM) to evaluate the importance of feature vectors, which can hierarchically drop redundant feature vectors and significantly accelerate the inference. To reduce the transmission overhead, we then design a unified codebook for feature representation to serve multiple tasks, where only the indices of these task-specific features in the codebook are transmitted. According to the simulation results, the proposed U-DeepSC achieves comparable performance to the task-oriented semantic communication system designed for a specific task but with significant reduction in both transmission overhead and model size.
Keyword:
Deep learning
dynamic overhead
multimodal data
multi-task semantic communication
Deep learning
dynamic overhead
multimodal data
multi-task semantic communication
期刊
IF:
8.3
论文数:
1.2W
被引数:
3.6W
机构
引用论文
A Vision of 6G Wireless Systems: Applications, Trends, Technologies, and Open Research Problems6g无线系统的愿景: 应用，趋势，技术和开放研究问题.png)
IEEE NETWORK
OAAI
IEEE NETWORKIF6.3
OAAI分享收藏分享收藏分享收藏Palladium-catalyzed substitution of esters of naphthylmethanols, 1-naphthylethanols, and analogues by sodium dimethyl malonate. Stereoselective synthesis from enantiomerically pure substratesTetrahedron
TetrahedronIF0
PREAI
分享收藏Joint Task and Data-Oriented Semantic Communications: A Deep Separate Source-Channel Coding Scheme联合任务和面向数据的语义通信: 一种深度分离的源信道编码方案OAAI
OAAI分享收藏From Semantic Communication to Semantic-Aware Networking: Model, Architecture, and Open Problems从语义通信到语义感知网络: 模型、体系结构和开放问题OAAI
OAAI分享收藏
查看更多内容