arrow
Return

Video Frame Interpolation via Generalized Deformable Convolution

delete2022-01-01
delete41
delete
OA
AI
X
Xiaohong Liu
K
Kangdi Shi
L
Linhui Dai
陈军 cover
陈军 (Jun Chen) *
DOI:10.1109/TMM.2021.3052419delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Video frame interpolation aims at synthesizing intermediate frames from nearby source frames while maintaining spatial and temporal consistencies. The existing deep-learning-based video frame interpolation methods can be roughly divided into two categories: flow-based methods and kernel-based methods. The performance of flow-based methods is often jeopardized by the inaccuracy of flow map estimation due to oversimplified motion models, while that of kernel-based methods tends to be constrained by the rigidity of kernel shape. To address these performance-limiting issues, a novel mechanism named generalized deformable convolution is proposed, which can effectively learn motion information in a data-driven manner and freely select sampling points in space-time. We further develop a new video frame interpolation method based on this mechanism. Our extensive experiments demonstrate that the new method performs favorably against the state-of-the-art, especially when dealing with complex motions. Code is available at https://github.com/zhshi0816/GDConvNet.
Keywords:
Convolution
Interpolation
Kernel
Shape
Streaming media
Estimation
Task analysis
Generalized deformable convolution
video frame interpolation
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Multimedia cover
IEEE Transactions on Multimedia
IF:
9.7
Papers:
4.6K
Citations:
2.4W

Organization

M
McMaster University
Scholars:
3.6W
Papers: 3.3W
Citations: 4.4W
Cited Papers

Cited Papers

Judgment Capacity, Fear of Falling, and the Risk of Falls in Community-Dwelling Older Adults: The Progetto Veneto Anziani Longitudinal Study
err2020-06-01
err0
errOAAI
errCaterina Trevisan; Bruno M. Zanforlini; Stefania Maggi; Marianna Noale; Federica Limongi; Marina De Rui; Maria Chiara Corti; Egle Perissinotto; Anna-Karin Welmer; Enzo Manzato; Giuseppe Sergi
errShare
errSave
errShare
errSave
MRFN: Multi-Receptive-Field Network for Fast and Accurate Single Image Super-Resolution
err2020-04-01
err73
PREAI
errHe, Zewei; Cao, Yanpeng; Du, Lei; Xu, Baobei; Yang, Jiangxin; Cao, Yanlong; Tang, Siliang; Zhuang, Yueting
errShare
errSave
researcher View more