arrow
返回

RFRFlow: Recurrent Feature Refinement Network for Optical Flow Estimation

delete2023-11-01
delete5
PRE
AI
Z
Zifan Zhu
C
Chen Huang
M
Menghan Xia
B
Biyun Xu
H
Hao Fang *
Z
Zhenghua Huang *
DOI:10.1109/JSEN.2023.3318371delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Optical flow represents vector motion of targets, and its estimation is a hot research in computer vision. The traditional prior-based methods build mathematical models using different regularizers on object characteristics. These methods are straightforward and easily understood, but they suffer from a high-computational burden. Deep learning-based approaches greatly improve their efficiency, but their filter sizes are fixed and receptive fields (RFs) are large. To solve these problems, this article proposes a novel recurrent feature refinement network based on short-term dense connection modules for optical flow estimation (RFRFlow), including the following key parts: first, we utilize short-term dense concatenate (STDC) modules as a backbone part for constructing a feature extracting network, which can preserve rich details and use global averaging pooling to extract global context information with a large RF. Second, a 4-D correlation volume is constructed using context features of image pairs to extract multiscale 4-D correlation information. Third, a motion feature encoder (MFE) is reported to transfer the multiscale 4-D correlation information into 2-D motion features. Finally, 2-D context features and 2-D motion features are input into a global motion aggregation (GMA) decoder for pursuing the final optical flow. In the experiments, we first present and analyze the results of ablation studies on the selection of batch size and image size. Then, both quantitative and qualitative results on Sintel and KITTI datasets are compared, showing that the proposed RFRFlow is effective and even performs better than the state-of-the-art optical flow estimation methods on performance improvement and objects' shape preservation.
Keyword:
Feature extraction
Optical imaging
Correlation
Optical sensors
Estimation
Data mining
Optical distortion
Decoder
encoder
optical flow estimation
recurrent feature refinement
short-term dense concatenate (STDC)

期刊

IEEE Sensors Journal 封面图
IEEE Sensors Journal
IF:
4.5
论文数:
2.2W
被引数:
7.3W

机构

W
Wuhan Donghu University
学者数:
232
论文数: 261
被引数: 870
W
wuhan institute of technology
学者数:
1.0W
论文数: 6.6K
被引数: 11
引用论文

引用论文

err分享
err收藏
Judgment Capacity, Fear of Falling, and the Risk of Falls in Community-Dwelling Older Adults: The Progetto Veneto Anziani Longitudinal Study社区居住的老年人的判断能力,对跌倒的恐惧和跌倒的风险: Progetto Veneto Anziani纵向研究
err2020-06-01
err0
errOAAI
errCaterina Trevisan; Bruno M. Zanforlini; Stefania Maggi; Marianna Noale; Federica Limongi; Marina De Rui; Maria Chiara Corti; Egle Perissinotto; Anna-Karin Welmer; Enzo Manzato; Giuseppe Sergi
err分享
err收藏
err分享
err收藏
err分享
err收藏
Preparation, fluxionality and some reactions of ring-linked [Fe2η,η-C5H4-A-B-C5H4(CO)4−n(CNMe)n] complexes
err1995-02-01
err0
PREAI
errAnthony R. Manning; Kevin Boss; M.Gary Cox; Anita McCabe; Payl Soye; Stephen C. Wade; Patrick A. McArdle; Desmond Cunningham
err分享
err收藏
Computer-Vision-Based Vibration Tracking Using a Digital Camera: A Sparse-Optical-Flow-Based Target Tracking Method
errSENSORS
IF3.5
err2022-09-11
err8
errOAAI
errNie, Guang-Yu; Bodda, Saran Srikanth; Sandhu, Harleen Kaur; Han, Kevin; Gupta, Abhinav
err分享
err收藏
Anesthetizer of the adult sea cucumber Apostichopus japonicus
err2005-01-01
err0
errOAAI
errYUSUKE YAMANA; TATSUO HAMANO; KEN-ICHI YAMAMOTO
err分享
err收藏
学者 查看更多内容