A Block PatchMatch-Based Energy-Resource Efficient Stereo Matching Processor on FPGA

doi:10.1109/TCSI.2022.3161266

2022-07-01

PRE

DOI：10.1109/TCSI.2022.3161266

原文链接

原文求助

摘要

En 中文

This paper presents a field programmable gate array (FPGA)-based, high-performance and energy-resource efficient stereo matching processor. The proposed processor executes block-level PatchMatch-based stereo matching algorithm with a random search strategy to avoid estimation of all disparity levels. To take advantages of different block scales, a coarse-to-fine multi-scale propagation (MSP) scheme is proposed for label update. Based on that, a dedicated hardware architecture is further proposed to explore the benefit of the algorithm. Experimental results show that the proposed FPGA-based processor, running at 350MHz, achieves a peak performance of 1920x1080.165.7 frame per second (FPS) at 128 disparity levels with 3.35W power dissipation. The energy and resource efficiency of the proposed design outperforms state-of-the-art FPGA-based stereo matching processors. When disparity level increases to 256, the computing resource increment of the proposed design is much less than existing designs because random search instead of winner-takes-all (WTA) is utilized. Moreover, unlike existing dedicated stereo matching processors which output only disparity information, the proposed design is also capable of deriving plane slant. This information can be beneficial for follow-up tasks like 3D reconstruction.

Keyword:

Costs

Hardware

Real-time systems

Computational complexity

Three-dimensional displays

Field programmable gate arrays

Cameras

Stereo matching

PatchMatch

multi-scale propagation (MSP)

energy-resource efficient

field programmable gate array (FPGA)

期刊

IEEE Transactions on Circuits and Systems I-Regular Papers

IF:

5.2

论文数:

9.9K

被引数:

2.2W

机构

ShanghaiTech University

学者数:

9.7K

论文数: 5.9K

被引数: 1.6W

引用论文

Stacking fault reduction during annealing in Cu-poor CuInSe2 thin film solar cell absorbers analyzed by in situ XRD and grain growth modeling

Journal of Applied Physics

IF0

2019-01-18

OAAI

Helena Stange; Stephan Brunken; Dieter Greiner; Marc Daniel Heinemann; Daniel Antonio Barragan Yani; Leonard Alwin Wägele; Chen Li; Ekin Simsek Sanli; Max Kahnt; Sebastian Simon Schmidt; Jan-Peter Bäcker; Christian Alexander Kaufmann; Manuela Klaus; Roland Scheer; Christoph Genzel; Roland Mainz

Neoadjuvant cisplatin and bevacizumab in triple negative breast cancer (TNBC): Safety and efficacy

Journal of Clinical Oncology

IF0

2009-05-20

PREAI

P. D. Ryan; N. M. Tung; S. J. Isakoff; M. Golshan; A. Richardson; A. D. Corben; B. L. Smith; R. Gelman; E. P. Winer; J. E. Garber

Primary hypoparathyroidism in dogs: a retrospective study of 17 cases

Australian Veterinary Journal

IF0

2006-08-02

PREAI

NJ RUSSELL; KA BOND; ID ROBERTSON; BW PARRY; PJ IRWIN