arrow
Return

Video epitomes

delete2006-12-23
delete21
PRE
AI
V
Vincent C. K. Cheung *
B
Brendan J. Frey
N
Nebojša Jojić
DOI:10.1007/s11263-006-0001-4delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Recently, epitomes were introduced as patch-based probability models that are learned by compiling together a large number of examples of patches from input images. In this paper, we describe how epitomes can be used to model video data and we describe significant computational speedups that can be incorporated into the epitome inference and learning algorithm. In the case of videos, epitomes are estimated so as to model most of the small spacetime cubes from the input data. Then, the epitome can be used for various modeling and reconstruction tasks, of which we show results for video super-resolution, video interpolation, and object removal. Besides computational efficiency, an interesting advantage of the epitome as a representation is that it can be reliably estimated even from videos with large amounts of missing data. We illustrate this ability on the task of reconstructing the dropped frames in video broadcast using only the degraded video and also in denoising a severely corrupted video.
Keywords:
epitome
video summarization
em algorithm
variational technique
super-resolution
inpainting
object removal
image restoration
missing data
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

International Journal of Computer Vision cover
International Journal of Computer Vision
IF:
9.3
Papers:
3.9K
Citations:
2.8W

Organization

M
Microsoft
Scholars:
3.0K
Papers: 2.7K
Citations: 7
U
university of toronto
Scholars:
14.7W
Papers: 12.0W
Citations: 165