arrow
Return

A Unified Acceleration Solution Based on Deformable Network for Image Pixel Processing

delete2023-09-01
delete2
PRE
AI
W
Wendong Mao
Z
Ziqi Su
J
Jiapeng Luo
Z
Zhongfeng Wang *
DOI:10.1109/TCSII.2023.3272050delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Recently, deep neural networks, including convolutional neural networks, deformable convolutional networks, and generative adversarial networks, have shown promising potential for image pixel processing tasks, such as image super-resolution and denoising. These various networks bring different memory accesses and complex computation patterns, challenging their hardware deployments seriously. Therefore, this brief proposes a field-unified method to transform various convolutions into a specific deformable convolution with an adaptive receptive field. Based on the transformation, a tile engine, together with a novel position-decoupling computing flow, is developed to unify the multiple memory access patterns, which maintains the consistency of input/output layout formats. Then, a high-level hardware architecture is presented to flexibly support multiple types of convolutional layers. The proposed design is implemented on a Zynq UltraScale+ FPGA board. Experimental results show that our design obtains around $1.4\times $ computation efficiency improvement, surpassing existing works in terms of hardware flexibility and computation efficiency significantly.
Keywords:
Image pixel processing
deconvolution
convolution
deformable convolution
reconfigurable architecture
dilated convolution
hardware design

Journal

I
IEEE Transactions on Circuits and Systems and Express Briefs
IF:
4.9
Papers:
8.8K
Citations:
2.5W

Organization

N
nanjing university
Scholars:
7.8W
Papers: 5.6W
Citations: 87
Cited Papers

Cited Papers

Improved outcome in HLA-identical sibling hematopoietic stem-cell transplantation for acute myelogenous leukemia predicted by KIR and HLA genotypes
err2005-06-15
err0
errOAAI
errKatharine C. Hsu; Carolyn A. Keever-Taylor; Andrew Wilton; Clara Pinto; Glenn Heller; Knarik Arkun; Richard J. O'Reilly; Mary M. Horowitz; Bo Dupont
errShare
errSave
5‐(2‐Thienyl)tetrazolates as Ligands for RuII–Polypyridyl Complexes: Synthesis, Electrochemistry and Photophysical Properties
err2010-08-17
err0
PREAI
errStefano Stagni; Antonio Palazzi; Pierpaolo Brulatti; Mauro Salmi; Sara Muzzioli; Stefano Zacchini; Massimo Marcaccio; Francesco Paolucci
errShare
errSave
New Structures and Techniques for Easy Axial Loading Test of Static and Fatigue Properties of MEMS Materials
err2005-11-15
err0
PREAI
errJun Hyub Park; Chung Youb Kim; Sung Hoon Choa; Chang Seung Lee; Woo Seong Che; Ji Ho Song
errShare
errSave
Effects of chelated Zn/Cu/Mn on redox status, immune responses and hoof health in lactating Holstein cows
err2015-01-01
err0
errOAAI
errXue-Jun Zhao; Zhong-Peng Li; Jun-Hong Wang; Xiang-Ming Xing; Zhen-Yong Wang; Lin Wang; Zhong-Hua Wang
errShare
errSave
researcher View more