Efficient Tensor Compression and Reconstruction in Split DNNs for Edge-Based Object Detection

doi:10.1109/JIOT.2026.3658835

Return

Efficient Tensor Compression and Reconstruction in Split DNNs for Edge-Based Object Detection

2026-01-28

PRE

Yenchia Yu

Matteo Mendula

Marco Levorato

Marina Papatriantafilou

Carla Fabiana Chiasserini

DOI：10.1109/JIOT.2026.3658835

Original

Original request for help

Save

Abstract

En 中文

Computer vision (CV) tasks are among the most pivotal, yet challenging, operations for uncrewed aerial vehicles (UAVs), especially in mission-critical applications. They require processing complex image data through deep neural networks (DNNs), which demand computational resources far beyond UAVs’ capacity. To address this limitation, Split DNNs offer a promising solution by partitioning the model into: 1) a lightweight Head, deployed on the UAV for rapid, albeit less precise, initial image representations, and 2) a more complex Tail, executed at the network edge for refined, higher accuracy results. However, this solution necessitates transmitting large tensor data from the UAV to the edge server, leading to significant bandwidth consumption. We tackle this challenge by introducing a goal-oriented framework named compressed tensor-based DNN split (CoTeD). Our framework integrates an application- and system-aware optimization model that orchestrates computing and transmission resources in real time. At the UAV, CoTeD dynamically selects relevant tensor information and optimally tradesoff between DNN detection quality and bandwidth consumption, guided by application requirements and system operational conditions. At the edge server, CoTeD reconstructs the tensor, enabling efficient inference by the Tail model. This approach effectively balances bandwidth usage with the quality of the CV task output. Experimental results, obtained through our hardware-software testbed and using datasets with different sizes and characteristics, show that CoTeD can reduce data transmission over the radio link by up to 90% without noticeable loss in object detection quality and inference latency by up to 70% compared to local DNN deployment onboard the UAV. Also, CoTeD yields an inference request success rate of at least 90%, with an increase of 20%–80% compared to direct DNN splitting, static Joint Photographic Experts Group (JPEG) compression, and DNN model quantization.

Keywords:

Bandwidth utilization

edge computing

orchestration

uncrewed aerial vehicles (UAVs)