arrow
Return

A Memory-Efficient Depthwise Separable Convolution Accelerator Using Run-Length Coding

delete2026-09-02
delete0
delete
OA
AI
J
Jaeseong Kim
T
Taehong Min
C
Chaebin Lee
D
Dayoung Lee
S
Seung Eun Lee *
DOI:10.3390/electronics15173762delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
On edge devices, convolutional neural network (CNN) inference is bottlenecked mainly by memory bandwidth, owing to the frequent memory accesses to feature maps and parameters. To address this challenge, we propose a memory-efficient hardware accelerator for depthwise separable convolution that minimizes off-chip memory traffic and parameter storage. The proposed architecture employs three key techniques: (1) a 64-bit run-length coding (RLC) packet compression that exploits feature-map sparsity after ReLU, (2) a mixed-precision scheme that represents feature maps and weights at different precisions, and (3) separated depthwise and pointwise convolution units. In particular, feature maps are transferred in RLC-compressed form, which reduces the amount of data exchanged with the host. The compressed data are decoded row by row, so the on-chip buffers hold only the rows required for computation rather than a complete feature map. In software simulation on ImageNet, the mixed-precision scheme reduced the parameter storage by 49.22% at a cost of 6.24 percentage points (pp) in Top-1 accuracy, and the RLC reduced the data by up to 56.07% in the deeper layers. Implemented on a Xilinx ZCU-104 FPGA, the proposed accelerator performs the depthwise separable convolution with a small number of logic resources and on-chip memory, confirming its feasibility for resource-constrained edge devices.
Keywords:
hardware accelerator
run-length coding (RLC)
depthwise separable convolution (DSC)
mixed-precision
edge AI

Journal

Electronics cover
Electronics
IF:
2.6
Papers:
1.1W
Citations:
4.7W

Organization

S
seoul national university of science and technology
Scholars:
589
Papers: 273
Citations: 0
Cited Papers

Cited Papers

Accelerating Strawberry Ripeness Classification Using a Convolution-Based Feature Extractor along with an Edge AI Processor
err2024-01-13
err0
errOAAI
errJoungmin Park; Jinyoung Shin; Raehyeong Kim; Seongmo An; Sangho Lee; Jinyeol Kim; Jongwon Oh; Youngwoo Jeong; Soohee Kim; Yue Ri Jeong; Seung Eun Lee
errShare
errSave
errShare
errSave
ImageNet: A large-scale hierarchical image database
err2009-06-01
err0
PREAI
errJia Deng; Wei Dong; Richard Socher; Li-Jia Li; Kai Li; Li Fei-Fei
errShare
errSave
A High-Performance CNN Processor Based on FPGA for MobileNets
err2019-09-01
err0
PREAI
errDi Wu; Yu Zhang; Xijie Jia; Lu Tian; Tianping Li; Lingzhi Sui; Dongliang Xie; Yi Shan
errShare
errSave
Real-Time True Wireless Stereo Wearing Detection Using a PPG Sensor with Edge AI
err2026-03-03
err0
errOAAI
errRaehyeong Kim; Joungmin Park; Jaeseong Kim; Jongwon Oh; Seung Eun Lee
errShare
errSave
errShare
errSave
researcher View more