.png){kind=icon}
Return
Over-the-Air Computation Empowered Vertically Split Inference
.png){kind=icon}
PRE
AI
DOI：10.1109/TWC.2024.3485678.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
To tackle the issue of heterogeneous input raw data samples obtained by different devices and enhance the feature extraction capability of edge devices, we propose a vertically split neural network based edge-device collaborative artificial intelligence (AI) inference framework. The local results calculated by various light-size sub-networks at edge devices are transmitted and aggregated at the server for the downstream inference task. Nevertheless, the transmission of such high-dimensional local results involves severe communication overhead. To resolve this issue, the technique of over-the-air computation (AirComp) is adopted to enable low-latency aggregation. The same entry of all devices' local results is transmitted over a same wireless resource block and aggregated via the waveform superposition property. Furthermore, to simultaneously support the aggregation of all dimensions of the local results, we consider a broadband channel and leverage orthogonal frequency division multiplexing (OFDM) to divide the system bandwidth into multiple subcarriers which are then assigned for different dimensions. Consequently, an extra degree of freedom is introduced to design the aggregation of all dimensions. We then propose a scheme of joint subcarrier allocation, power allocation, and receiver beamforming to minimize the aggregation distortion and enhance inference performance. Extensive experiments are conducted to verify the superiority of the proposed design over benchmarks.
Keywords:
Feature extraction
Servers
Neural networks
Resource management
Collaboration
Artificial intelligence
Optimization
Computational modeling
Array signal processing
OFDM
Split inference
neural networks
over-the-air computation
Journal
IF:
10.7
Papers:
1.3W
Citations:
5.3W
Organization
View more organizations
Cited Papers
ShareSaveShareSave
Edge Intelligence: Paving the Last Mile of Artificial Intelligence With Edge Computing.png)
PROCEEDINGS OF THE IEEE
OAAI
PROCEEDINGS OF THE IEEEIF25.9
OAAIShareSaveShareSaveShareSave View more