arrow
Return

Learning to Optimize Halide with Tree Search and Random Programs

delete2019-07-12
delete147
PRE
AI
A
Andrew Adams *
K
Karima Ma
R
Riyadh Baghdadi
T
Tzu‐Mao Li
M
Michaël Gharbi
B
Benoit Steiner
S
Steven Johnson
K
Kayvon Fatahalian
F
Frédo Durand
J
Jonathan Ragan‐Kelley
DOI:10.1145/3306346.3322967delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
We present a new algorithm to automatically schedule Halide programs for high-performance image processing and deep learning. We significantly improve upon the performance of previous methods, which considered a limited subset of schedules. We define a parameterization of possible schedules much larger than prior methods and use a variant of beam search to search over it. The search optimizes runtime predicted by a cost model based on a combination of new derived features and machine learning. We train the cost model by generating and featurizing hundreds of thousands of random programs and schedules. We show that this approach operates effectively with or without autotuning. It produces schedules which are on average almost twice as fast as the existing Halide autoscheduler without autotuning, or more than twice as fast with, and is the first automatic scheduling algorithm to significantly outperform human experts on average.
Keywords:
optimizing compilers
Halide
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

ACM Transactions on Graphics cover
ACM Transactions on Graphics
IF:
9.5
Papers:
4.8K
Citations:
3.6W

Organization

A
adobe systems inc.
Scholars:
273
Papers: 305
Citations: 0
F
facebook inc
Scholars:
588
Papers: 381
Citations: 0
U
University of California Berkeley
Scholars:
3.5W
Papers: 2.8W
Citations: 11.3W
University of California System cover
University of California System
Scholars:
37.7W
Papers: 33.8W
Citations: 6.6K
G
Google Incorporated
Scholars:
3.5K
Papers: 1.8K
Citations: 8
researcher View more organizations
Cited Papers

Cited Papers

Vías de exposición a plaguicidas en escolares de la Provincia de Talca, Chile
err2014-05-01
err0
errOAAI
errMaría Teresa Muñoz-Quezada; Boris Lucero; Verónica Iglesias; María Pía Muñoz
errShare
errSave
AAHA Senior Care Guidelines for Dogs and Cats
err2005-03-01
err0
PREAI
errMark Epstein; Ned F. Kuehn; Gary Landsberg; B. Duncan X. Lascelles; Steven L. Marks; Jean M. Schaedler; Helen Tuzio
errShare
errSave
A Survey on Compiler Autotuning using Machine Learning
err2018-09-18
err123
errOAAI
errAshouri, Amir H.; Killian, William; Cavazos, John; Palermo, Gianluca; Silvano, Cristina
errShare
errSave
Decoupling Algorithms from Schedules for Easy Optimization of Image Processing Pipelines
err2012-07-01
err141
errOAAI
errRagan-Kelley, Jonathan; Adams, Andrew; Paris, Sylvain; Levoy, Marc; Amarasinghe, Saman; Durand, Fredo
errShare
errSave
Direct Measurement of the Spin-Orbit Interaction in a Two-Electron InAs Nanowire Quantum Dot
err2007-06-26
err0
errOAAI
errC. Fasth; A. Fuhrer; L. Samuelson; Vitaly N. Golovach; Daniel Loss
errShare
errSave
Bilateral Guided Upsampling
err2016-12-05
err82
errOAAI
errChen, Jiawen; Adams, Andrew; Wadhwa, Neal; Hasinoff, Samuel W.
errShare
errSave
[36] Using macromolecular crowding agents to identify weak interactions within DNA replication complexes
err1995-01-01
err0
PREAI
errMichael K. Reddy; Stephen E. Weitzel; Shirley S. Daube; Thale C. Jarvis; Peter H. von Hippel
errShare
errSave
Darkroom: Compiling High-Level Image Processing Code into Hardware Pipelines
err2014-07-27
err167
PREAI
errHegarty, James; Brunhaver, John; DeVito, Zachary; Ragan-Kelley, Jonathan; Cohen, Noy; Bell, Steven; Vasilyev, Artem; Horowitz, Mark; Hanrahan, Pat
errShare
errSave
researcher View more