.png){kind=icon}
返回
On Content-Aware Post-Processing: Adapting Statistically Learned Models to Dynamic Content
.png){kind=icon}
OA
AI
DOI：10.1145/3612925.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Learning-based post-processing methods generally produce neural models that are statistically optimal on their training datasets. These models, however, neglect intrinsic variations of local video content and may fail to process unseen content. To address this issue, this article proposes a content-aware approach for the post-processing of compressed videos. We develop a backbone network, called BackboneFormer, where a Fast Transformer using Separable Self-Attention, Spatial Attention, and Channel Attention is devised to support underlying feature embedding and aggregation. Furthermore, we introduce Meta-learning to strengthen BackboneFormer for better performance. Specifically, we propose Meta Post-Processing (Meta-PP) which leverages the Meta-learning framework to drive BackboneFormer to capture and analyze input video variations for spontaneous updating. Since the original frame is unavailable to the decoder, we devise a Compression Degradation Estimation model where a low-complexity neural model and classic operators are used collaboratively to estimate the compression distortion. The estimated distortion is then utilized to guide the BackboneFormer model for dynamic updating of weighting parameters. Experimental results demonstrate that the proposed BackboneFormer itself gains about 3.61% Bjontegaard delta bit-rate reduction over Versatile Video Coding in the post-processing task and BackboneFormer + Meta-PP attains 4.32%, costing only 50K and 61K parameters, respectively. The computational complexity of MACs is 49k/pixel and 50k/pixel, which represents only about 16% of state-of-the-art methods having similar coding gains.
Keyword:
VVC
in-loop filtering
post-processing
transformer
Meta-learning
期刊
IF:
6
论文数:
2.0K
被引数:
5.4K
机构
引用论文
Caw’s Walking State Recognition Based on Accelerometers and Gyroscopes Installed on Ear-Tags and Collar-Tags基于安装在耳标和项圈上的加速度计和陀螺仪的Caw步行状态识别
PREAI
分享收藏
Inflexibility of mental planning: A characteristic disorder with prefrontal lobe lesions?心理计划的僵化: 前额叶病变的特征性障碍？
PREAI
分享收藏VARIATION WITH DEPTH IN SHALLOW AND DEEP WATER MARINE SEDIMENTS OF POROSITY, DENSITY AND THE VELOCITIES OF COMPRESSIONAL AND SHEAR WAVES.png)
GEOPHYSICS
GEOPHYSICSIF0
PREAI
分享收藏分享收藏Phase Diagram for Two-Dimensional Spin Systems with Ladder, Plaquette and Mixed-Spin Structures
PREAI
分享收藏
查看更多内容