.png){kind=icon}
返回
Deep Video Super-Resolution Using HR Optical Flow Estimation
.png){kind=icon}
OA
AI
DOI：10.1109/TIP.2020.2967596.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Video super-resolution (SR) aims at generating a sequence of high-resolution (HR) frames with plausible and temporally consistent details from their low-resolution (LR) counterparts. The key challenge for video SR lies in the effective exploitation of temporal dependency between consecutive frames. Existing deep learning based methods commonly estimate optical flows between LR frames to provide temporal dependency. However, the resolution conflict between LR optical flows and HR outputs hinders the recovery of fine details. In this paper, we propose an end-to-end video SR network to super-resolve both optical flows and images. Optical flow SR from LR frames provides accurate temporal dependency and ultimately improves video SR performance. Specifically, we first propose an optical flow reconstruction network (OFRnet) to infer HR optical flows in a coarse-to-fine manner. Then, motion compensation is performed using HR optical flows to encode temporal dependency. Finally, compensated LR inputs are fed to a super-resolution network (SRnet) to generate SR results. Extensive experiments have been conducted to demonstrate the effectiveness of HR optical flows for SR performance improvement. Comparative results on the Vid4 and DAVIS-10 datasets show that our network achieves the state-of-the-art performance.
Keyword:
Video super-resolution
optical flow estimation
temporal consistency
scale-recurrent architecture
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
13.7
论文数:
1.0W
被引数:
8.4W
机构
引用论文
Red, green, and blue electrochromism in ambipolar poly(amine–amide–imide)s based on electroactive tetraphenyl‐p‐phenylenediamine units基于电活性四苯基 p-苯二胺单元的双极性聚 (胺-酰胺-酰亚胺) 中的红色，绿色和蓝色电致变色
PREAI
分享收藏Analysis of the Relative Stabilities of Ortho, Meta, and Para MClY(XC4H4)(PH3)2Heterometallabenzenes (M = Rh, Ir; X = N, P; Y = Cl and M = Ru, Os; X = N, P; Y = CO)邻位，间位和对位的相对稳定性分析 (XC4H4)(PH3)2 杂金属苯 (M = Rh，Ir；X = N，P; Y = Cl和M = Ru，Os; X = N，P; Y = CO)
PREAI
分享收藏Wireless Underground Communications in Sewer and Stormwater Overflow Monitoring: Radio Waves through Soil and Asphalt Medium.png)
InformationOAAI
InformationIF0
OAAI分享收藏
查看更多内容