arrow
Return

Video Enhancement with Task-Oriented Flow

delete2019-02-12
delete878
delete
OA
AI
X
Xue, Tianfan
C
Chen, Baian
Jiajun Wu cover
Jiajun Wu (Jiajun Wu) *
D
Donglai Wei
F
Freeman, William T.
DOI:10.1007/s11263-018-01144-2delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Many video enhancement algorithms rely on optical flow to register frames in a video sequence. Precise flow estimation is however intractable; and optical flow itself is often a sub-optimal representation for particular video processing tasks. In this paper, we propose task-oriented flow (TOFlow), a motion representation learned in a self-supervised, task-specific manner. We design a neural network with a trainable motion estimation component and a video processing component, and train them jointly to learn the task-oriented flow. For evaluation, we build Vimeo-90K, a large-scale, high-quality video dataset for low-level video processing. TOFlow outperforms traditional optical flow on standard benchmarks as well as our Vimeo-90K dataset in three video processing tasks: frame interpolation, video denoising/deblocking, and video super-resolution.
Keywords:
Video processing
Optical flow
Neural network
Video dataset
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

International Journal of Computer Vision cover
International Journal of Computer Vision
IF:
9.3
Papers:
3.9K
Citations:
2.8W

Organization

H
Harvard University
Scholars:
26.5W
Papers: 22.0W
Citations: 28.7W
G
Google Incorporated
Scholars:
3.5K
Papers: 1.8K
Citations: 8
Cited Papers

Cited Papers

errShare
errSave
errShare
errSave
errShare
errSave
Molecular Characterization and Cluster Analysis of Field Isolates of Avian Infectious Laryngotracheitis Virus from Argentina
err2017-12-13
err0
errOAAI
errMaría I. Craig; Maria F. Rojas; Claudia A. van der Ploeg; Valeria Olivera; Ariel E. Vagnozzi; Andrés M. Perez; Guido A. König
errShare
errSave
Nonlocal video denoising, simplification and inpainting using discrete regularization on graphs
err2010-08-01
err23
PREAI
errGhoniem, Mahmoud; Chahir, Youssef; Elmoataz, Abderrahim
errShare
errSave
WHY URBAN GEOCHEMISTRY?
err2012-12-28
err0
PREAI
errW. B. Lyons; R. S. Harmon
errShare
errSave
A Numerical Study of Turbulence Statistics and the Structure of a Spatially-Developing Boundary Layer Over a Realistic Urban Geometry
err2017-04-27
err0
PREAI
errAtsushi Inagaki; Manabu Kanda; Nurul Huda Ahmad; Ayako Yagi; Naoyuki Onodera; Takayuki Aoki
errShare
errSave
researcher View more