arrow
Return

Rigel: Flexible Multi-Rate Image Processing Hardware

delete2016-07-11
delete65
PRE
AI
J
James Hegarty *
R
Ross Daly
Z
Zachary DeVito
J
Jonathan Ragan‐Kelley
M
Mark Horowitz
P
Pat Hanrahan
DOI:10.1145/2897824.2925892delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Image processing algorithms implemented using custom hardware or FPGAs of can be orders-of-magnitude more energy efficient and performant than software. Unfortunately, converting an algorithm by hand to a hardware description language suitable for compilation on these platforms is frequently too time consuming to be practical. Recent work on hardware synthesis of high-level image processing languages demonstrated that a single-rate pipeline of stencil kernels can be synthesized into hardware with provably minimal buffering. Unfortunately, few advanced image processing or vision algorithms fit into this highly-restricted programming model. In this paper, we present Rigel(1), which takes pipelines specified in our new multi-rate architecture and lowers them to FPGA implementations. Our flexible multi-rate architecture supports pyramid image processing, sparse computations, and space-time implementation tradeoffs. We demonstrate depth from stereo, Lucas-Kanade, the SIFT descriptor, and a Gaussian pyramid running on two FPGA boards. Our system can synthesize hardware for FPGAs with up to 436 Megapixels/second throughput, and up to 297 x faster runtime than a tablet-class ARM CPU.
Keywords:
Image processing
domain-specific languages
hardware synthesis
FPGAs
video processing
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

ACM Transactions on Graphics cover
ACM Transactions on Graphics
IF:
9.5
Papers:
4.7K
Citations:
3.6W

Organization

S
Stanford University
Scholars:
9.6W
Papers: 8.2W
Citations: 17.0W