.png){kind=icon}
返回
Disparity-Aware Reference Frame Generation Network for Multiview Video Coding
.png){kind=icon}
PRE
AI
DOI：10.1109/TIP.2022.3183436.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Multiview video coding (MVC) aims to compress the multiview video through the elimination of video redundancies, where the quality of the reference frame directly affects the compression efficiency. In this paper, we propose a deep virtual reference frame generation method based on a disparity-aware reference frame generation network (DAG-Net) to transform the disparity relationship between different viewpoints and generate a more reliable reference frame. The proposed DAG-Net consists of a multi-level receptive field module, a disparity-aware alignment module, and a fusion reconstruction module. First, a multi-level receptive field module is designed to enlarge the receptive field, and extract the multi-scale deep features of the temporal and inter-view reference frames. Then, a disparity-aware alignment module is proposed to learn the disparity relationship, and perform disparity shift on the inter-view reference frame to align it with the temporal reference frame. Finally, a fusion reconstruction module is utilized to fuse the complementary information and generate a more reliable virtual reference frame. Experiments demonstrate that the proposed reference frame generation method achieves superior performance for multiview video coding.
Keyword:
Image coding
Video coding
Deep learning
Image reconstruction
Estimation
Encoding
Task analysis
Multiview video coding
reference frame generation
disparity-aware alignment
DAG-Net
3D-HEVC
期刊
IF:
13.7
论文数:
1.0W
被引数:
8.4W
机构
引用论文
Dense-view synthesis for three-dimensional light-field display based on unsupervised learning.png)
OPTICS EXPRESS
OAAI
OPTICS EXPRESSIF3.3
OAAI分享收藏
查看更多内容