arrow
返回

Over-the-Air Computation Empowered Vertically Split Inference

delete2024-12-01
delete0
PRE
AI
P
Peng Yang
D
Dingzhu Wen *
Q
Qunsong Zeng
Y
Yong Zhou
T
Ting Wang *
H
Haibin Cai
Y
Yuanming Shi
DOI:10.1109/TWC.2024.3485678delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
To tackle the issue of heterogeneous input raw data samples obtained by different devices and enhance the feature extraction capability of edge devices, we propose a vertically split neural network based edge-device collaborative artificial intelligence (AI) inference framework. The local results calculated by various light-size sub-networks at edge devices are transmitted and aggregated at the server for the downstream inference task. Nevertheless, the transmission of such high-dimensional local results involves severe communication overhead. To resolve this issue, the technique of over-the-air computation (AirComp) is adopted to enable low-latency aggregation. The same entry of all devices' local results is transmitted over a same wireless resource block and aggregated via the waveform superposition property. Furthermore, to simultaneously support the aggregation of all dimensions of the local results, we consider a broadband channel and leverage orthogonal frequency division multiplexing (OFDM) to divide the system bandwidth into multiple subcarriers which are then assigned for different dimensions. Consequently, an extra degree of freedom is introduced to design the aggregation of all dimensions. We then propose a scheme of joint subcarrier allocation, power allocation, and receiver beamforming to minimize the aggregation distortion and enhance inference performance. Extensive experiments are conducted to verify the superiority of the proposed design over benchmarks.
Keyword:
Feature extraction
Servers
Neural networks
Resource management
Collaboration
Artificial intelligence
Optimization
Computational modeling
Array signal processing
OFDM
Split inference
neural networks
over-the-air computation

期刊

IEEE Transactions on Wireless Communications 封面图
IEEE Transactions on Wireless Communications
IF:
10.7
论文数:
1.3W
被引数:
5.3W

机构

U
University of Hong Kong
学者数:
4.1W
论文数: 3.9W
被引数: 10.1W
E
east china normal university
学者数:
3.1W
论文数: 2.1W
被引数: 25
S
ShanghaiTech University
学者数:
9.7K
论文数: 5.9K
被引数: 1.6W
学者 查看更多机构
引用论文

引用论文

HIDL: High-Throughput Deep Learning Inference at the Hybrid Mobile Edge
err2022-12-01
err30
errOAAI
errWu, Jing; Wang, Lin; Pei, Qiangyu; Cui, Xingqi; Liu, Fangming; Yang, Tingting
err分享
err收藏
Choosing Where to Attend and the Medial Frontal Cortex: An fMRI Study
err2008-09-01
err0
errOAAI
errPaul C. J. Taylor; Matthew F. S. Rushworth; Anna C. Nobre
err分享
err收藏
Reconfigurable Intelligent Surface for Green Edge Inference
err2021-06-01
err45
errOAAI
errHua, Sheng; Zhou, Yong; Yang, Kai; Shi, Yuanming; Wang, Kunlun
err分享
err收藏
学者 查看更多内容