返回
A Unified Acceleration Solution Based on Deformable Network for Image Pixel Processing
DOI:10.1109/TCSII.2023.3272050.png)
摘要
En 中文
Recently, deep neural networks, including convolutional neural networks, deformable convolutional networks, and generative adversarial networks, have shown promising potential for image pixel processing tasks, such as image super-resolution and denoising. These various networks bring different memory accesses and complex computation patterns, challenging their hardware deployments seriously. Therefore, this brief proposes a field-unified method to transform various convolutions into a specific deformable convolution with an adaptive receptive field. Based on the transformation, a tile engine, together with a novel position-decoupling computing flow, is developed to unify the multiple memory access patterns, which maintains the consistency of input/output layout formats. Then, a high-level hardware architecture is presented to flexibly support multiple types of convolutional layers. The proposed design is implemented on a Zynq UltraScale+ FPGA board. Experimental results show that our design obtains around $1.4\times $ computation efficiency improvement, surpassing existing works in terms of hardware flexibility and computation efficiency significantly.
Keyword:
Image pixel processing
deconvolution
convolution
deformable convolution
reconfigurable architecture
dilated convolution
hardware design
期刊
I
IF:
4.9
论文数:
8.8K
被引数:
2.5W
机构
引用论文
Presenting Concerns of Veterans Entering Treatment for Posttraumatic Stress Disorder提出退伍军人进入创伤后应激障碍治疗的担忧
Improved outcome in HLA-identical sibling hematopoietic stem-cell transplantation for acute myelogenous leukemia predicted by KIR and HLA genotypes
Blood
IF0
A Flexible and Efficient FPGA Accelerator for Various Large-Scale and Lightweight CNNs适用于各种大规模和轻量级cnn的灵活高效的FPGA加速器
Hard template synthesis of crystalline mesoporous anatase TiO2 for photocatalytic hydrogen evolution

