arrow
返回

Reference-based In-loop Filter with Robust Neural Feature Transfer for Video Coding

delete2024-12-23
delete0
delete
OA
AI
N
Nayoung Kim
W
Webtoon, Naver
L
Lee, Jung-kyung
K
Kang, Je-Won *
DOI:10.1145/3702643delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
In this article, we propose an efficient reference-based deep in-loop filtering method for video coding. Existing reference-based in-loop filters often face challenges in improving coding efficiency due to the difficulty in capturing relevant textures from the reference frames. Our method accurately predicts the texture of a reference block and uses this information to restore the current block. To achieve this, we develop a reference-to-current feature estimation module that conveys high-quality information from previously coded frames in the feature domain, thereby preventing loss of detail due to inaccurate prediction. Although a neural network is trained to restore a coded video frame to be similar to the current frame, their performance can significantly degrade when operating with various quantization parameters (QPs) and managing different levels of distortion. This problem becomes further severe in the reference-to-current feature estimation, in which QP values are applied differently to video frames. We address this problem by developing a QP-aware convolution layer with a small number of learnable parameters to generate reliable features and adapt to fine-grained adaptive QPs among consecutive frames. The proposed method is implemented into the versatile video coding (VVC) reference software, VTM version 10.0. Experimental results demonstrate that the proposed method improves coding performance significantly in VVC.
Keyword:
Deep learning
in-loop filter
Versatile Video Coding
reference-based in-loop filter
quantization artifact removal

期刊

ACM Transactions on Multimedia Computing Communications and Applications 封面图
ACM Transactions on Multimedia Computing Communications and Applications
IF:
6
论文数:
2.0K
被引数:
5.4K

机构

N
naver
学者数:
152
论文数: 129
被引数: 1
E
Ewha Womans University
学者数:
1.2W
论文数: 1.1W
被引数: 1.2W
引用论文

引用论文

Attention-Based Dual-Scale CNN In-Loop Filter for Versatile Video Coding
err2019-01-01
err31
errOAAI
errWang, Ming-Ze; Wan, Shuai; Gong, Hao; Ma, Ming-Yang
err分享
err收藏
err分享
err收藏
err分享
err收藏
Scleral contact lenses for the management of complicated ptosis
err2017-10-20
err0
PREAI
errKonstantinos Katsoulos; Gerasimos Livir Rallatos; Ioannis Mavrikakis
err分享
err收藏
学者 查看更多内容