.png){kind=icon}
返回
Classification-Driven Discrete Neural Representation Learning for Semantic Communications
.png){kind=icon}
PRE
AI
DOI：10.1109/JIOT.2024.3354312.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Semantic communications is a key enabler of the Internet of Things (IoT). By focusing on the semantic meaning of data rather than bit-level recovery, it allows intelligent agents to communicate necessary information at much lower rates. A promising technique for semantic communications is discrete neural representation learning (DNRL). The main idea is to learn discrete symbols from low-level, high-dimensional sensory data, such that each symbol is grounded to a meaningful pattern in the sensory domain. This article proposes a DNRL scheme that integrates three mechanisms into a coherent framework: 1) contrastive learning; 2) sparse coding; and 3) neural index quantization. The proposed scheme is applied to public image data sets for lossy image compression with a downstream classification task. Results show that the proposed approach produces a highly compact continuous latent representation and a semantic discrete representation, with marginal degradation to the classification accuracy. The interpretability and consistency of the learned subsymbolic discrete representations are validated by experiments of neural-net dissection, neural-net visualization, and MaxAmp-K classification test, a concept that we propose to evaluate classification performance of extremely compressed signals. Finally, the discrete representations are shown to be useful in rate-adaptive distributed sensing applications at the low-to-medium signal-to-noise ratios (SNRs).
Keyword:
Data compression
distributed detection
image classification
image representations
neural networks
quantization
期刊
IF:
8.9
论文数:
1.4W
被引数:
7.8W
机构
引用论文
Elektronische effekte in cyclopentadienyl-chrom-komplexen, die mehrere akzeptorliganden enthalten
.png){kind=icon}
PREAI
分享收藏Kalium‐μ‐dithio‐bis(pentacyanokobaltat(III)) und Kalium‐μ‐diseleno‐bis(pentacyanokobaltat(III))
PREAI
分享收藏
分享收藏
查看更多内容