arrow
返回

Eventfulness for Interactive Video Alignment

delete2023-07-26
delete0
PRE
AI
J
Jiatian Sun *
L
Longxiulin Deng
T
Triantafyllos Afouras
A
Andrew Owens
A
Abe Davis
DOI:10.1145/3592118delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Humans are remarkably sensitive to the alignment of visual events with other stimuli, which makes synchronization one of the hardest tasks in video editing. A key observation of our work is that most of the alignment we do involves salient localizable events that occur sparsely in time. By learning how to recognize these events, we can greatly reduce the space of possible synchronizations that an editor or algorithm has to consider. Furthermore, by learning descriptors of these events that capture additional properties of visible motion, we can build active tools that adapt their notion of eventfulness to a given task as they are being used. Rather than learning an automatic solution to one specific problem, our goal is to make a much broader class of interactive alignment tasks significantly easier and less timeconsuming. We show that a suitable visual event descriptor can be learned entirely from stochastically-generated synthetic video. We then demonstrate the usefulness of learned and adaptive eventfulness by integrating it in novel interactive tools for applications including audio-driven time warping of video and the extraction and application of sound effects across different videos.
Keyword:
video
audio
alignment
editing
interaction
synth2real

期刊

ACM Transactions on Graphics 封面图
ACM Transactions on Graphics
IF:
9.5
论文数:
4.7K
被引数:
3.6W

机构

U
University of Michigan
学者数:
6.4W
论文数: 5.3W
被引数: 124
C
Cornell University
学者数:
6.3W
论文数: 5.4W
被引数: 10.9W
U
university of michigan system
学者数:
9.1W
论文数: 8.6W
被引数: 133
学者 查看更多机构
引用论文

引用论文

Deploying Fixed Wing Unoccupied Aerial Systems (UAS) for Coastal Morphology Assessment and Management
err2018-05-01
err0
errOAAI
errA.C. Seymour; J.T. Ridge; A.B. Rodriguez; E. Newton; J. Dale; D.W. Johnston
err分享
err收藏
audeosynth: Music-Driven Video Montage
err2015-07-27
err19
errOAAI
errLiao, Zicheng; Yu, Yizhou; Gong, Bingchen; Cheng, Lechao
err分享
err收藏
The role of the polyamine inhibitor eflornithine in the neuropathogenesis of experimental murine African trypanosomiasis
err1997-06-01
err0
PREAI
errF. W. Jennings; C. W. Gichuki; P. G. E. Kennedy; J. Rodgers; C. A. Hunter; M. Murray; J. M. Burke
err分享
err收藏
Development and characterization of 430L matrix composites gradient materials
err2005-03-01
err0
errOAAI
errElisa Maria Ruiz-Navas; Elena Gordo; Ricardo García
err分享
err收藏
Effects of different cryopreservation methods on post-thaw culture conditions of in vitro produced bovine embryos
err2011-03-16
err0
PREAI
errAlessandra Corallo Nicacio; Renata Simões; Fabiola Freitas de Paula-Lopes; Flavia Regina Oliveira de Barros; Maria Angelica Peres; Mayra Elena Ortiz D'Avila Assumpção; Jose Antonio Visintin
err分享
err收藏
Visual Rhythm and Beat视觉节奏和节拍
err2018-07-30
err37
PREAI
errDavis, Abe; Agrawala, Maneesh
err分享
err收藏
学者 查看更多内容