arrow
返回

Darkroom: Compiling High-Level Image Processing Code into Hardware Pipelines

delete2014-07-27
delete167
PRE
AI
J
James Hegarty *
J
John Brunhaver
Z
Zachary DeVito
J
Jonathan Ragan‐Kelley
N
Noy Cohen
S
Steven Bell
A
Artem Vasilyev
M
Mark Horowitz
P
Pat Hanrahan
DOI:10.1145/2601097.2601174delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Specialized image signal processors (ISPs) exploit the structure of image processing pipelines to minimize memory bandwidth using the architectural pattern of line-buffering, where all intermediate data between each stage is stored in small on-chip buffers. This provides high energy efficiency, allowing long pipelines with tera-op/sec. image processing in battery-powered devices, but traditionally requires painstaking manual design in hardware. Based on this pattern, we present Darkroom, a language and compiler for image processing. The semantics of the Darkroom language allow it to compile programs directly into line-buffered pipelines, with all intermediate values in local line-buffer storage, eliminating unnecessary communication with off-chip DRAM. We formulate the problem of optimally scheduling line-buffered pipelines to minimize buffering as an integer linear program. Finally, given an optimally scheduled pipeline, Darkroom synthesizes hardware descriptions for ASIC or FPGA, or fast CPU code. We evaluate Darkroom implementations of a range of applications, including a camera pipeline, low-level feature detection algorithms, and deblurring. For many applications, we demonstrate gigapixel/sec. performance in under 0.5mm(2) of ASIC silicon at 250 mW (simulated on a 45nm foundry process), real-time 1080p/60 video processing using a fraction of the resources of a modern FPGA, and tens of megapixels/sec. of throughput on a quad-core x86 processor.
Keyword:
Image processing
domain-specific languages
hardware synthesis
FPGAs
video processing
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

ACM Transactions on Graphics 封面图
ACM Transactions on Graphics
IF:
9.5
论文数:
4.8K
被引数:
3.6W

机构

S
Stanford University
学者数:
9.6W
论文数: 8.2W
被引数: 17.0W
引用论文

引用论文

Anatomy of a vertical metal halide discharge
err1989-11-01
err0
PREAI
errJames T. Dakin; Theodore H. Rautenberg; Evelyn M. Goldfield
err分享
err收藏
Clinical Predictors of Response to Clozapine Treatment in Ambulatory Patients With Schizophrenia
err2002-05-15
err0
PREAI
errDaniel S. Umbricht; William C. Wirshing; Donna A. Wirshing; Marjorie McMeniman; Nina R. Schooler; Stephen R. Marder; John M. Kane
err分享
err收藏
GRAMPS: A Programming Model for Graphics PipelinesGRAMPS: 图形管道的编程模型
err2009-02-09
err61
PREAI
errSugerman, Jeremy; Fatahalian, Kayvon; Boulos, Solomon; Akeley, Kurt; Hanrahan, Pat
err分享
err收藏
Decoupling Algorithms from Schedules for Easy Optimization of Image Processing Pipelines
err2012-07-01
err141
errOAAI
errRagan-Kelley, Jonathan; Adams, Andrew; Paris, Sylvain; Levoy, Marc; Amarasinghe, Saman; Durand, Fredo
err分享
err收藏
学者 查看更多内容