arrow
返回

A Unified Acceleration Solution Based on Deformable Network for Image Pixel Processing

delete2023-09-01
delete2
PRE
AI
W
Wendong Mao
Z
Ziqi Su
J
Jiapeng Luo
Z
Zhongfeng Wang *
DOI:10.1109/TCSII.2023.3272050delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Recently, deep neural networks, including convolutional neural networks, deformable convolutional networks, and generative adversarial networks, have shown promising potential for image pixel processing tasks, such as image super-resolution and denoising. These various networks bring different memory accesses and complex computation patterns, challenging their hardware deployments seriously. Therefore, this brief proposes a field-unified method to transform various convolutions into a specific deformable convolution with an adaptive receptive field. Based on the transformation, a tile engine, together with a novel position-decoupling computing flow, is developed to unify the multiple memory access patterns, which maintains the consistency of input/output layout formats. Then, a high-level hardware architecture is presented to flexibly support multiple types of convolutional layers. The proposed design is implemented on a Zynq UltraScale+ FPGA board. Experimental results show that our design obtains around $1.4\times $ computation efficiency improvement, surpassing existing works in terms of hardware flexibility and computation efficiency significantly.
Keyword:
Image pixel processing
deconvolution
convolution
deformable convolution
reconfigurable architecture
dilated convolution
hardware design

期刊

I
IEEE Transactions on Circuits and Systems and Express Briefs
IF:
4.9
论文数:
8.8K
被引数:
2.5W

机构

N
nanjing university
学者数:
7.8W
论文数: 5.6W
被引数: 87
引用论文

引用论文

Improved outcome in HLA-identical sibling hematopoietic stem-cell transplantation for acute myelogenous leukemia predicted by KIR and HLA genotypes
err2005-06-15
err0
errOAAI
errKatharine C. Hsu; Carolyn A. Keever-Taylor; Andrew Wilton; Clara Pinto; Glenn Heller; Knarik Arkun; Richard J. O'Reilly; Mary M. Horowitz; Bo Dupont
err分享
err收藏
5‐(2‐Thienyl)tetrazolates as Ligands for RuII–Polypyridyl Complexes: Synthesis, Electrochemistry and Photophysical Properties
err2010-08-17
err0
PREAI
errStefano Stagni; Antonio Palazzi; Pierpaolo Brulatti; Mauro Salmi; Sara Muzzioli; Stefano Zacchini; Massimo Marcaccio; Francesco Paolucci
err分享
err收藏
New Structures and Techniques for Easy Axial Loading Test of Static and Fatigue Properties of MEMS Materials
err2005-11-15
err0
PREAI
errJun Hyub Park; Chung Youb Kim; Sung Hoon Choa; Chang Seung Lee; Woo Seong Che; Ji Ho Song
err分享
err收藏
Effects of chelated Zn/Cu/Mn on redox status, immune responses and hoof health in lactating Holstein cows
err2015-01-01
err0
errOAAI
errXue-Jun Zhao; Zhong-Peng Li; Jun-Hong Wang; Xiang-Ming Xing; Zhen-Yong Wang; Lin Wang; Zhong-Hua Wang
err分享
err收藏
学者 查看更多内容