.png){kind=icon}
返回
Task-Oriented Communication for Multidevice Cooperative Edge Inference
.png){kind=icon}
OA
AI
DOI：10.1109/TWC.2022.3191118.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
This paper investigates task-oriented communication for multi-device cooperative edge inference, where a group of distributed low-end edge devices transmit the extracted features of local samples to a powerful edge server for inference. While cooperative edge inference can overcome the limited sensing capability of a single device, it substantially increases the communication overhead and may incur excessive latency. To enable low-latency cooperative inference, we propose a learning-based communication scheme that optimizes local feature extraction and distributed feature encoding in a task-oriented manner, i.e., to remove data redundancy and transmit information that is essential for the downstream inference task rather than reconstructing the data samples at the edge server. Specifically, we leverage Tishby's information bottleneck (IB) principle (Tishby et al., 2000) to extract the task-relevant feature at each edge device, and adopt the distributed information bottleneck (DIB) framework of Aguerri and Zaidi, 2021, to formalize a single-letter characterization of the optimal rate-relevance tradeoff for distributed feature encoding. To admit flexible control of the communication overhead, we extend the DIB framework to a distributed deterministic information bottleneck (DDIB) objective that explicitly incorporates the representational costs of the encoded features. As the IB-based objectives are computationally prohibitive for high-dimensional data, we adopt variational approximations to make the optimization problems tractable. To compensate for the potential performance loss due to the variational approximations, we also develop a selective retransmission (SR) mechanism to identify the redundancy in the encoded features among multiple edge devices to attain additional communication overhead reduction. Extensive experiments on multi-view image classification and multi-view object recognition tasks evidence that the proposed task-oriented communication scheme achieves a better rate-relevance tradeoff than existing methods.
Keyword:
Feature extraction
Task analysis
Encoding
Servers
Distributed databases
Performance evaluation
Image edge detection
Task-oriented communication
information bottleneck (IB)
distributed information bottleneck (DIB)
variational inference
期刊
IF:
10.7
论文数:
1.3W
被引数:
5.3W
机构
引用论文
Etude optique in vivo des éléments photorécepteurs dans l'œil composé de Drosophila.png)
Kybernetik
KybernetikIF0
PREAI
分享收藏Edge Intelligence: Paving the Last Mile of Artificial Intelligence With Edge Computing边缘智能: 用边缘计算铺平人工智能的最后一英里PROCEEDINGS OF THE IEEE
OAAI
PROCEEDINGS OF THE IEEEIF25.9
OAAI分享收藏Architectural Protein Subclasses Shape 3D Organization of Genomes during Lineage CommitmentCellOAAI
CellIF0
OAAI分享收藏
查看更多内容