.png){kind=icon}
Return
Eventfulness for Interactive Video Alignment
.png){kind=icon}
PRE
AI
DOI：10.1145/3592118.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Humans are remarkably sensitive to the alignment of visual events with other stimuli, which makes synchronization one of the hardest tasks in video editing. A key observation of our work is that most of the alignment we do involves salient localizable events that occur sparsely in time. By learning how to recognize these events, we can greatly reduce the space of possible synchronizations that an editor or algorithm has to consider. Furthermore, by learning descriptors of these events that capture additional properties of visible motion, we can build active tools that adapt their notion of eventfulness to a given task as they are being used. Rather than learning an automatic solution to one specific problem, our goal is to make a much broader class of interactive alignment tasks significantly easier and less timeconsuming. We show that a suitable visual event descriptor can be learned entirely from stochastically-generated synthetic video. We then demonstrate the usefulness of learned and adaptive eventfulness by integrating it in novel interactive tools for applications including audio-driven time warping of video and the extraction and application of sound effects across different videos.
Keywords:
video
audio
alignment
editing
interaction
synth2real
Journal
IF:
9.5
Papers:
4.7K
Citations:
3.6W
Organization
Cited Papers
ShareSaveShareSaveShareSaveEffects of different cryopreservation methods on post-thaw culture conditions of in vitro produced bovine embryos.png)
Zygote
ZygoteIF0
PREAI
ShareSaveShareSave
View more