arrow
返回

Enhanced Motion-Compensated Video Coding With Deep Virtual Reference Frame Generation

delete2019-10-01
delete62
PRE
AI
L
Lei Zhao
S
Shiqi Wang
X
Xinfeng Zhang
王苫社 封面图
王苫社 (Shanshe Wang) *
马
马思伟 (Siwei Ma)
高
高雯 (Wen Gao)
DOI:10.1109/TIP.2019.2913545delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
In this paper, we propose an efficient inter prediction scheme by introducing the deep virtual reference frame (VRF), which serves better reference in the temporal redundancy removal process of video coding. In particular, the high quality VRF is generated with the deep learning-based frame rate up conversion (FRUC) algorithm from two reconstructed bi-directional frames, which is subsequently incorporated into the reference list serving as the high quality reference. Moreover, to alleviate the compression artifacts of VRF, we develop a convolutional neural network (CNN)-based enhancement model to further improve its quality. To facilitate better utilization of the VRF, a CTU level coding mode termed as direct virtual reference frame (DVRF) is devised, which achieves better trade-off between compression performance and complexity. The proposed scheme is integrated into HM-16.6 and JEM-7.1 software platforms, and the simulation results under random access (RA) configuration demonstrate significant superiority of the proposed method. When adding VRF to RPS, more than 6% average BD-rate gain is achieved for HEVC test sequences on HM-16.6, and 0.8% BD-rate gain is observed based on JEM-7.1 software. Regarding the DVRF mode, 3.6% bitrate saving is achieved on HM-16.6 with the computational complexity effectively reduced.
Keyword:
Inter prediction
virtual reference frame
deep learning
video coding
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Image Processing 封面图
IEEE Transactions on Image Processing
IF:
13.7
论文数:
1.0W
被引数:
8.4W

机构

C
City University of Hong Kong
学者数:
2.3W
论文数: 3.0W
被引数: 6.1W
P
peking university
学者数:
11.9W
论文数: 8.7W
被引数: 146
C
chinese academy of sciences
学者数:
56.7W
论文数: 45.0W
被引数: 704
学者 查看更多机构
引用论文

引用论文

Uncertainty Propagation via Probability Measure Optimized Importance Weights with Application to Parametric Materials Models
err2019-01-06
err0
PREAI
errMeet Sanghvi; Pejman Honarmandi; Vahid Attari; Thien Duong; Raymundo Arroyave; Douglas L. Allaire
err分享
err收藏
The structures of AH10 and AH11, nobel bi-phenylethylchromones from agalwood.
err1986-01-01
err0
errOAAI
errKiyoshi Iwagoe; Tenji Konishi; Shiu Kiyosawa; Yasuo Shimada; Kazumoto Miyahara; Toshio Kawasaki
err分享
err收藏
err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
err分享
err收藏
Transcript degradation and codon usage regulate gene expression in a lytic phage†
err2019-12-31
err0
errOAAI
errBenjamin R Jack; Daniel R Boutz; Matthew L Paff; Bartram L Smith; Claus O Wilke
err分享
err收藏
Background-Modeling-Based Adaptive Prediction for Surveillance Video Coding
err2014-02-01
err101
PREAI
errZhang, Xianguo; Huang, Tiejun; Tian, Yonghong; Gao, Wen
err分享
err收藏
学者 查看更多内容