arrow
返回

Recurrent Spatial Pyramid CNN for Optical Flow Estimation

delete2018-10-01
delete44
PRE
AI
P
Ping Hu *
G
Gang Wang
Y
Yap‐Peng Tan
DOI:10.1109/TMM.2018.2815784delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Optical flow estimation plays an important role in many multimedia and computer vision tasks. Although great progress has been made in applying convolutional neural networks (CNNs) to estimate optical flow in recent works, it is still difficult for CNNs to generate optical flow with the desired effectiveness and efficiency. Compared to CNN-based methods, conventional variational methods normally perform to optimize an energy function and produce optical flow with more precise details. Inspired by the effectiveness of variational methods and deep CNNs, we propose a recurrent spatial pyramid (RecSPy) network for optical flow estimation. To deal with large displacements and to decrease the number of parameters, we formulate the spatial pyramid as a recurrent process, and adopt a CNN to refine optical flow at each spatial scale. Furthermore, to improve the results with more precise details, we propose an energy function that encodes structure and constancy constraints to help refine the optical flow at each spatial scale. The combination of the proposed RecSPy network and the proposed energy-based refinement enables our system to estimate optical flow effectively and efficiently. Experimental results on the benchmarks validate the effectiveness and efficiency of the proposed method.
Keyword:
Optical flow estimation
convolutional neural network
coarse-to-fine refinement
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Multimedia 封面图
IEEE Transactions on Multimedia
IF:
9.7
论文数:
4.5K
被引数:
2.4W

机构

A
alibaba group
学者数:
1.1K
论文数: 789
被引数: 0
N
Nanyang Technological University
学者数:
4.9W
论文数: 4.8W
被引数: 8.1W
引用论文

引用论文

Illumination Robust Video Foreground Prediction Based on Color Recovering
err2014-04-01
err12
PREAI
errWan, Yanli; Miao, Zhenjiang; Zhang, Xiao-Ping; Tang, Zhen; Wang, Zhifei
err分享
err收藏
WHY URBAN GEOCHEMISTRY?
err2012-12-28
err0
PREAI
errW. B. Lyons; R. S. Harmon
err分享
err收藏
err分享
err收藏
DeepMatching: Hierarchical Deformable Dense Matching
err2016-04-29
err214
errOAAI
errRevaud, Jerome; Weinzaepfel, Philippe; Harchaoui, Zaid; Schmid, Cordelia
err分享
err收藏
Highly accurate optic flow computation with theoretically justified warping
err2006-01-28
err375
PREAI
errPapenberg, Nils; Bruhn, Andres; Brox, Thomas; Didas, Stephan; Weickert, Joachim
err分享
err收藏
学者 查看更多内容