arrow
返回

Communication-Efficient Framework for Distributed Image Semantic Wireless Transmission

delete2023-12-15
delete6
delete
OA
AI
B
Bingyan Xie
Y
Yongpeng Wu *
Y
Yuxuan Shi
D
Derrick Wing Kwan Ng
W
Wenjun Zhang
DOI:10.1109/JIOT.2023.3304650delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Multinode communication, which refers to the interaction among multiple devices, has attracted lots of attention in many Internet of Things (IoT) scenarios. However, its huge amounts of data flows and inflexibility for task extension have triggered the urgent requirement of communication-efficient distributed data transmission frameworks. In this article, inspired by the great superiorities on bandwidth reduction and task adaptation of semantic communications, we propose a federated learning (FL)-based semantic communication (FLSC) framework for multitask distributed image transmission with IoT devices. FL enables the design of independent semantic communication link of each user while further improves the semantic extraction and task performance through global aggregation. Each link in FLSC is composed of a hierarchical vision transformer (HVT)-based extractor and a task-adaptive translator for coarse-to-fine semantic extraction and meaning translation according to specific tasks. In order to extend the FLSC into more realistic conditions, we design a channel state information-based multiple-input-multiple-output transmission module to combat channel fading and noise. Simulation results show that the coarse semantic information can deal with a range of image-level tasks. Moreover, especially in low signal-to-noise ratio (SNR) and channel bandwidth ratio regimes, FLSC evidently outperforms the traditional scheme, e.g., about 10 peak SNR gain in the 3-dB channel condition.
Keyword:
Channel state information (CSI)
distributed image transmission
hierarchical vision transformer (HVT)
Internet of Things (IoT)
semantic communication

期刊

IEEE Internet of Things Journal 封面图
IEEE Internet of Things Journal
IF:
8.9
论文数:
1.4W
被引数:
7.8W

机构

S
shanghai jiao tong university
学者数:
15.7W
论文数: 11.7W
被引数: 159
引用论文

引用论文

err分享
err收藏
err分享
err收藏
Single Positive Lymph Node Prostate Cancer Can Be Treated Surgically without Recurrence
err2016-03-31
err0
errOAAI
errDae Keun Kim; Kyo Chul Koo; Ali Abdel Raheem; Ki Hong Kim; Byung Ha Chung; Young Deuk Choi; Koon Ho Rha
err分享
err收藏
Structural Neural Substrates of Reading the Mind in the Eyes在眼睛中阅读心灵的结构神经基质
err2016-04-11
err0
errOAAI
errWataru Sato; Takanori Kochiyama; Shota Uono; Reiko Sawada; Yasutaka Kubota; Sayaka Yoshimura; Motomi Toichi
err分享
err收藏
err分享
err收藏
Improving Vision Transformers to Learn Small-Size Dataset From Scratch
err2022-01-01
err28
errOAAI
errLee, Seunghoon; Lee, Seunghyun; Song, Byung Cheol
err分享
err收藏
err分享
err收藏
学者 查看更多内容