.png){kind=icon}
返回
Cross-Modal Semantic Communications
.png){kind=icon}
PRE
AI
DOI：10.1109/MWC.008.2200180.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
It is well known that multi-modal services, including video, audio, and haptic signals, aim to provide immersive experience with low latency and high reliability. Although multi-modal signals have differences in structure, transmission delay, and jitter, there are potential cross-modal relations among these multi-modal signals that can be explored to realize multi-modal signal processing and streaming. As a revolutionary communication paradigm, semantic communications can not only provide human-oriented services by delivering the intended meanings, but also break the modality barriers through compact semantic information extracted from multi-modal signals, which can help to achieve cross-modal applications. However, due to the polysemy and ambiguity issues, how to guarantee high reliability for semantic communications is a tremendous challenge. To overcome this dilemma, this article designs a cross-modal semantic communication paradigm that involves three modules: The cross-modal knowledge graph (CKG) provides essential background knowledge and signal patches for encoding and decoding respectively; the cross-modal semantic encoder infers potential implicit semantics to reduce encoding polysemy; and the cross-modal semantic decoder ensures consistency between source signals and recovered signals in terms of bit level and semantic level in order to reduce decoding ambiguity. They collaboratively improve the reliability of the communication system, which is verified by the simulation result.
Keyword:
Semantics
Feature extraction
Decoding
Haptic interfaces
Knowledge based systems
Communication systems
Reliability
期刊
IF:
11.5
论文数:
2.7K
被引数:
1.3W
机构
引用论文
Cobalt and Copper Composite Oxides as Efficient Catalysts for Preferential Oxidation of CO in H2-Rich Stream钴和铜复合氧化物作为H2-Rich流中CO优先氧化的有效催化剂
PREAI
分享收藏From Semantic Communication to Semantic-Aware Networking: Model, Architecture, and Open Problems从语义通信到语义感知网络: 模型、体系结构和开放问题
OAAI
OAAI分享收藏Toward Wisdom-Evolutionary and Primitive-Concise 6G: A New Paradigm of Semantic Communication Networks走向智慧进化和原始简洁6g: 语义通信网络的新范式.png)
ENGINEERING
OAAI
ENGINEERINGIF11.6
OAAI分享收藏
查看更多内容