ScissionLite: Accelerating Distributed Deep Learning With Lightweight Data Compression for IIoT

doi:10.1109/TII.2024.3413340

ScissionLite: Accelerating Distributed Deep Learning With Lightweight Data Compression for IIoT

2024-10-01

0

PRE

AI

DOI：10.1109/TII.2024.3413340

Original

Original request for help

Save

Abstract

En 中文

Industrial Internet of Things (IIoT) applications can greatly benefit from leveraging edge computing. For instance, applications relying on deep neural network (DNN) models can be sliced and distributed across IIoT devices and the network edge to reduce inference latency. However, low network performance between IIoT devices and the edge often becomes a bottleneck. In this study, we propose ScissionLite, a holistic framework designed to accelerate distributed DNN inference using lightweight data compression. Our compression method features a novel lightweight down/upsampling network tailored for performance-limited IIoT devices, which is inserted at the slicing point of a DNN model to reduce outbound network traffic without causing a significant drop in accuracy. In addition, we have developed a benchmarking tool to accurately identify the optimal slicing point of the DNN for the best inference latency. ScissionLite improves inference latency by up to 15.7x with minimal accuracy degradation.

Keywords:

Deep neural networks (DNN)

edge computing

industrial Internet of Things (IIoT)

inference

model slicing

ScissionLite: Accelerating Distributed Deep Learning With Lightweight Data Compression for IIoT

Abstract

Journal

Organization