Video Frame Interpolation via Generalized Deformable Convolution

doi:10.1109/TMM.2021.3052419

2022-01-01

DOI：10.1109/TMM.2021.3052419

原文链接

查看原文

摘要

En 中文

Video frame interpolation aims at synthesizing intermediate frames from nearby source frames while maintaining spatial and temporal consistencies. The existing deep-learning-based video frame interpolation methods can be roughly divided into two categories: flow-based methods and kernel-based methods. The performance of flow-based methods is often jeopardized by the inaccuracy of flow map estimation due to oversimplified motion models, while that of kernel-based methods tends to be constrained by the rigidity of kernel shape. To address these performance-limiting issues, a novel mechanism named generalized deformable convolution is proposed, which can effectively learn motion information in a data-driven manner and freely select sampling points in space-time. We further develop a new video frame interpolation method based on this mechanism. Our extensive experiments demonstrate that the new method performs favorably against the state-of-the-art, especially when dealing with complex motions. Code is available at https://github.com/zhshi0816/GDConvNet.

Keyword:

Convolution

Interpolation

Kernel

Shape

Streaming media

Estimation

Task analysis

Generalized deformable convolution

video frame interpolation

AI总结

对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Multimedia

IF:

9.7

论文数:

4.6K

被引数:

2.4W

机构

McMaster University

学者数:

3.6W

论文数: 3.3W

被引数: 4.4W

引用论文

Judgment Capacity, Fear of Falling, and the Risk of Falls in Community-Dwelling Older Adults: The Progetto Veneto Anziani Longitudinal Study 社区居住的老年人的判断能力，对跌倒的恐惧和跌倒的风险: Progetto Veneto Anziani纵向研究

Rejuvenation Research

IF0

2020-06-01

OAAI

Caterina Trevisan; Bruno M. Zanforlini; Stefania Maggi; Marianna Noale; Federica Limongi; Marina De Rui; Maria Chiara Corti; Egle Perissinotto; Anna-Karin Welmer; Enzo Manzato; Giuseppe Sergi

A qualitative study of 369 child welfare professionals' perspectives about factors contributing to employee retention and turnover

Children and Youth Services Review

IF0

2007-02-01

PREAI

Alberta J. Ellett; Jacquelyn I. Ellis; Tonya M. Westbrook; Denise' Dews

Caw’s Walking State Recognition Based on Accelerometers and Gyroscopes Installed on Ear-Tags and Collar-Tags 基于安装在耳标和项圈上的加速度计和陀螺仪的Caw步行状态识别

IEEE Latin America Transactions

IF0

2018-09-01

PREAI

Carlos Munoz Poblete; Nicolas Roa Munoz; Juan Ignacio Huircan Quilaqueo