.png){kind=icon}
返回
Generative Joint Source-Channel Coding for Semantic Image Transmission
.png){kind=icon}
OA
AI
DOI：10.1109/JSAC.2023.3288243.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Recent works have shown that joint source-channel coding (JSCC) schemes using deep neural networks (DNNs), called DeepJSCC, provide promising results in wireless image transmission. However, these methods mostly focus on the distortion of the reconstructed signals with respect to the input image, rather than their perception by humans. However, focusing on traditional distortion metrics alone does not necessarily result in high perceptual quality, especially in extreme physical conditions, such as very low bandwidth compression ratio (BCR) and low signal-to-noise ratio (SNR) regimes. In this work, we propose two novel JSCC schemes that leverage the perceptual quality of deep generative models (DGMs) for wireless image transmission, namely InverseJSCC and GenerativeJSCC. While the former is an inverse problem approach to DeepJSCC, the latter is an end-to-end optimized JSCC scheme. In both, we optimize a weighted sum of mean squared error (MSE) and learned perceptual image patch similarity (LPIPS) losses, which capture more semantic similarities than other distortion metrics. InverseJSCC performs denoising on the distorted reconstructions of a DeepJSCC model by solving an inverse optimization problem using the pre-trained style-based generative adversarial network (StyleGAN). Our simulation results show that InverseJSCC significantly improves the state-of-the-art DeepJSCC in terms of perceptual quality in edge cases. In GenerativeJSCC, we carry out end-to-end training of an encoder and a StyleGAN-based decoder, and show that GenerativeJSCC significantly outperforms DeepJSCC both in terms of distortion and perceptual quality.
Keyword:
Semantic communication
wireless communication
joint source-channel coding
perceptual similarity
generative adversarial networks
inverse problems
StyleGAN
期刊
IF:
17.2
论文数:
6.4K
被引数:
3.1W
机构
引用论文
分享收藏分享收藏Beyond Transmitting Bits: Context, Semantics, and Task-Oriented Communications超越传输位: 上下文，语义和面向任务的通信OAAI
OAAI分享收藏Palladium-catalyzed substitution of esters of naphthylmethanols, 1-naphthylethanols, and analogues by sodium dimethyl malonate. Stereoselective synthesis from enantiomerically pure substrates.png)
Tetrahedron
TetrahedronIF0
PREAI
分享收藏Scattering of electromagnetic plane wave from a chiral cylinder placed in chiral metamaterials放置在手性超材料中的手性圆柱体对电磁平面波的散射
PREAI
分享收藏
查看更多内容