arrow
Return

Scanner: Efficient Video Analysis at Scale

delete2018-07-30
delete53
delete
OA
AI
W
Will Crichton
P
Pat Hanrahan
K
Kayvon Fatahalian
DOI:10.1145/3197517.3201394delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
A growing number of visual computing applications depend on the analysis of large video collections. The challenge is that scaling applications to operate on these datasets requires efficient systems for pixel data access and parallel processing across large numbers of machines. Few programmers have the capability to operate efficiently at these scales, limiting the field's ability to explore new applications that leverage big video data. In response, we have created Scanner, a system for productive and efficient video analysis at scale. Scanner organizes video collections as tables in a data store optimized for sampling frames from compressed video, and executes pixel processing computations, expressed as dataflow graphs, on these frames. Scanner schedules video analysis applications expressed using these abstractions onto heterogeneous throughput computing hardware, such as multi-core CPUs, GPUs, and media processing ASICs, for high-throughput pixel processing. We demonstrate the productivity of Scanner by authoring a variety of video processing applications including the synthesis of stereo VR video streams from multi-camera rigs, markerless 3D human pose reconstruction from video, and data-mining big video datasets such as hundreds of feature-length films or over 70,000 hours of TV news. These applications achieve near-expert performance on a single machine and scale efficiently to hundreds of machines, enabling formerly long-running big video data analysis tasks to be carried out in minutes to hours.
Keywords:
large-scale video processing
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

ACM Transactions on Graphics cover
ACM Transactions on Graphics
IF:
9.5
Papers:
4.8K
Citations:
3.6W

Organization

C
Carnegie Mellon University
Scholars:
1.4W
Papers: 1.4W
Citations: 2.7W
S
Stanford University
Scholars:
9.6W
Papers: 8.2W
Citations: 17.0W
Cited Papers

Cited Papers

What Makes Paris Look like Paris?
err2012-07-01
err450
errOAAI
errDoersch, Carl; Singh, Saurabh; Gupta, Abhinav; Sivic, Josef; Efros, Alexei A.
errShare
errSave
errShare
errSave
Capacity optimization of hybrid renewable energy system considering part-load ratio and resource endowment
err2023-07-01
err0
PREAI
errLong Xu; Moucun Yang; Xinhe Wang; Kelong Diao; Yuezhao Zhu; Robert Taylor
errShare
errSave
Real-Time Hyperlapse Creation via Optimal Frame Selection
err2015-07-27
err75
PREAI
errJoshi, Neel; Kienzle, Wolf; Toelle, Mike; Uyttendaele, Matt; Cohen, Michael F.
errShare
errSave
Decoupling Algorithms from Schedules for Easy Optimization of Image Processing Pipelines
err2012-07-01
err141
errOAAI
errRagan-Kelley, Jonathan; Adams, Andrew; Paris, Sylvain; Levoy, Marc; Amarasinghe, Saman; Durand, Fredo
errShare
errSave
errShare
errSave
Direct Measurement of the Spin-Orbit Interaction in a Two-Electron InAs Nanowire Quantum Dot
err2007-06-26
err0
errOAAI
errC. Fasth; A. Fuhrer; L. Samuelson; Vitaly N. Golovach; Daniel Loss
errShare
errSave
Spreading of Alpha Synuclein from Glioblastoma Cells towards Astrocytes Correlates with Stem-like Properties
err2022-03-10
err0
errOAAI
errLarisa Ryskalin; Francesca Biagioni; Gabriele Morucci; Carla L. Busceti; Alessandro Frati; Stefano Puglisi-Allegra; Michela Ferrucci; Francesco Fornai
errShare
errSave
Transfiguring Portraits
err2016-07-11
err77
PREAI
errKemelmacher-Shlizerman, Ira
errShare
errSave
researcher View more