.png){kind=icon}
返回
Robust Semantic Communications With Masked VQ-VAE Enabled Codebook
.png){kind=icon}
OA
AI
DOI：10.1109/TWC.2023.3265201.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Although semantic communications have exhibited satisfactory performance on a large number of tasks, the impact of semantic noise and the robustness of the systems have not been well investigated. Semantic noise refers to the misleading between the intended semantic symbols and received ones, thus causes the failure of tasks. In this paper, we first propose a framework for the robust end-to-end semantic communication systems to combat the semantic noise. In particular, we analyze sample-dependent and sample-independent semantic noise. To combat the semantic noise, the adversarial training with weight perturbation is developed to incorporate the samples with semantic noise in the training dataset. Then, we propose to mask a portion of the input, where the semantic noise appears frequently, and design the masked vector quantized-variational autoencoder (VQ-VAE) with the noise-related masking strategy. We use a discrete codebook shared by the transmitter and the receiver for encoded feature representation. To further improve the system robustness, we develop a feature importance module (FIM) to suppress the noise-related and task-unrelated features. Thus, the transmitter simply needs to transmit the indices of these important task-related features in the codebook. Simulation results show that the proposed method can be applied in many downstream tasks and significantly improve the robustness against semantic noise with remarkable reduction on the transmission overhead.
Keyword:
Adversarial training
feature importance module (FIM)
masked vector quantized-variational autoencoder (VQ-VAE)
robust semantic communications
semantic noise
期刊
IF:
10.7
论文数:
1.3W
被引数:
5.3W
机构
引用论文
Enhanced Reactivity of Dinuclear Copper(I) Acetylides in Dipolar Cycloadditions偶极环加成反应中双核乙炔铜 (I) 的反应性增强
PREAI
分享收藏分享收藏Palladium-catalyzed substitution of esters of naphthylmethanols, 1-naphthylethanols, and analogues by sodium dimethyl malonate. Stereoselective synthesis from enantiomerically pure substrates.png)
Tetrahedron
TetrahedronIF0
PREAI
分享收藏Channel-Aware Adversarial Attacks Against Deep Learning-Based Wireless Signal Classifiers针对基于深度学习的无线信号分类器的信道感知对抗攻击OAAI
OAAI分享收藏From Semantic Communication to Semantic-Aware Networking: Model, Architecture, and Open Problems从语义通信到语义感知网络: 模型、体系结构和开放问题OAAI
OAAI分享收藏
查看更多内容