arrow
Return

Deep Joint Source-Channel Coding for Multi-Task Network

delete2021-01-01
delete14
delete
OA
AI
M
Mengyang Wang
Z
Zhicong Zhang
J
Jiahui Li
M
Mengyao Ma
范
范晓鹏 (Xiaopeng Fan) *
DOI:10.1109/LSP.2021.3113827delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Multi-task learning (MTL) is an efficient way to improve the performance of related tasks by sharing knowledge. However, most existing MTL networks run on a single end and are not suitable for collaborative intelligence (CI) scenarios. In this work, we propose an MTL network with a deep joint source-channel coding (JSCC) framework, which allows operating under CI scenarios. We first propose a feature fusion based MTL network (FFMNet) for joint object detection and semantic segmentation. Compared with other MTL networks, FFMNet gets higher performance with fewer parameters. Then FFMNet is split into two parts, which run on a mobile device and an edge server respectively. The feature generated by the mobile device is transmitted through the wireless channel to the edge server. To reduce the transmission overhead of the intermediate feature, a deep JSCC network is designed. By combining two networks together, the whole model achieves 512x compression for the intermediate feature and a performance loss within 2% on both tasks. At last, by training with noise, the FFMNet with JSCC is robust to various channel conditions and outperforms the separate source and channel coding scheme.
Keywords:
Feature extraction
Task analysis
Servers
Semantics
Object detection
Training
Mobile handsets
Collaborative intelligence
multi-task learning
deep joint source-channel coding

Journal

IEEE Signal Processing Magazine cover
IEEE Signal Processing Magazine
IF:
9.6
Papers:
1.1W
Citations:
1.7W

Organization

H
harbin institute of technology
Scholars:
8.0W
Papers: 6.6W
Citations: 66
H
huawei technologies
Scholars:
3.3K
Papers: 2.9K
Citations: 1
Cited Papers

Cited Papers

errShare
errSave
Mechanism of hydrogen treatment in KTiOPO4 crystals at high temperature: experimental and first-principles studies
err2015-01-01
err0
PREAI
errYang Zhang; Yanhua Leng; Jian Liu; Nianjing Ji; Xiulan Duan; Jing Li; Xian Zhao; Jiyang Wang; Huaidong Jiang
errShare
errSave
Choosing Where to Attend and the Medial Frontal Cortex: An fMRI Study
err2008-09-01
err0
errOAAI
errPaul C. J. Taylor; Matthew F. S. Rushworth; Anna C. Nobre
errShare
errSave
Mindful Sport Performance Enhancement (MSPE)
err2019-08-13
err0
PREAI
errKeith A. Kaufman; Carol R. Glass; Timothy R. Pineau
errShare
errSave
A vibrational study of the (S–S) group in transition-element compounds
err1970-01-01
err0
PREAI
errC. Perrin-Billot; A. Perrin; J. Prigent
errShare
errSave
The Open Images Dataset V4 Unified Image Classification, Object Detection, and Visual Relationship Detection at Scale
err2020-03-13
err1.1K
PREAI
errKuznetsova, Alina; Rom, Hassan; Alldrin, Neil; Uijlings, Jasper; Krasin, Ivan; Pont-Tuset, Jordi; Kamali, Shahab; Popov, Stefan; Malloci, Matteo; Kolesnikov, Alexander; Duerig, Tom; Ferrari, Vittorio
errShare
errSave
An overview of multi-task learning
err2017-09-01
err600
errOAAI
errZhang, Yu; Yang, Qiang
errShare
errSave
researcher View more