arrow
返回

Deep Joint Source-Channel Coding for Multi-Task Network

delete2021-01-01
delete14
delete
OA
AI
M
Mengyang Wang
Z
Zhicong Zhang
J
Jiahui Li
M
Mengyao Ma
范
范晓鹏 (Xiaopeng Fan) *
DOI:10.1109/LSP.2021.3113827delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Multi-task learning (MTL) is an efficient way to improve the performance of related tasks by sharing knowledge. However, most existing MTL networks run on a single end and are not suitable for collaborative intelligence (CI) scenarios. In this work, we propose an MTL network with a deep joint source-channel coding (JSCC) framework, which allows operating under CI scenarios. We first propose a feature fusion based MTL network (FFMNet) for joint object detection and semantic segmentation. Compared with other MTL networks, FFMNet gets higher performance with fewer parameters. Then FFMNet is split into two parts, which run on a mobile device and an edge server respectively. The feature generated by the mobile device is transmitted through the wireless channel to the edge server. To reduce the transmission overhead of the intermediate feature, a deep JSCC network is designed. By combining two networks together, the whole model achieves 512x compression for the intermediate feature and a performance loss within 2% on both tasks. At last, by training with noise, the FFMNet with JSCC is robust to various channel conditions and outperforms the separate source and channel coding scheme.
Keyword:
Feature extraction
Task analysis
Servers
Semantics
Object detection
Training
Mobile handsets
Collaborative intelligence
multi-task learning
deep joint source-channel coding

期刊

IEEE Signal Processing Magazine 封面图
IEEE Signal Processing Magazine
IF:
9.6
论文数:
1.1W
被引数:
1.7W

机构

H
harbin institute of technology
学者数:
8.0W
论文数: 6.6W
被引数: 66
H
huawei technologies
学者数:
3.3K
论文数: 2.9K
被引数: 1
引用论文

引用论文

err分享
err收藏
Mechanism of hydrogen treatment in KTiOPO4 crystals at high temperature: experimental and first-principles studies
err2015-01-01
err0
PREAI
errYang Zhang; Yanhua Leng; Jian Liu; Nianjing Ji; Xiulan Duan; Jing Li; Xian Zhao; Jiyang Wang; Huaidong Jiang
err分享
err收藏
Choosing Where to Attend and the Medial Frontal Cortex: An fMRI Study
err2008-09-01
err0
errOAAI
errPaul C. J. Taylor; Matthew F. S. Rushworth; Anna C. Nobre
err分享
err收藏
Mindful Sport Performance Enhancement (MSPE)
err2019-08-13
err0
PREAI
errKeith A. Kaufman; Carol R. Glass; Timothy R. Pineau
err分享
err收藏
A vibrational study of the (S–S) group in transition-element compounds
err1970-01-01
err0
PREAI
errC. Perrin-Billot; A. Perrin; J. Prigent
err分享
err收藏
The Open Images Dataset V4 Unified Image Classification, Object Detection, and Visual Relationship Detection at Scale
err2020-03-13
err1.1K
PREAI
errKuznetsova, Alina; Rom, Hassan; Alldrin, Neil; Uijlings, Jasper; Krasin, Ivan; Pont-Tuset, Jordi; Kamali, Shahab; Popov, Stefan; Malloci, Matteo; Kolesnikov, Alexander; Duerig, Tom; Ferrari, Vittorio
err分享
err收藏
err分享
err收藏
学者 查看更多内容