arrow
返回

Towards Hybrid-Optimization Video Coding

delete2024-04-24
delete0
delete
OA
AI
S
Shuai Huo
刘东 (Dong Liu) *
H
Haotian Zhang
李莉 (Li Li)
马思伟 (Siwei Ma)
吴枫 (Feng Wu)
W
Wen Gao
DOI:10.1145/3652148delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Video coding that pursues the highest compression efficiency is the art of computing for rate-distortion optimization. The optimization has been approached in different ways, exemplified by two typical frameworks: block-based hybrid video coding and end-to-end learned video coding. The block-based hybrid framework encompasses more and more coding modes that are available at the decoder side; an encoder tries to search for the optimal coding mode for each block to be coded. This is an online, discrete, search-based optimization strategy. The end-to-end learned framework embraces more and more sophisticated neural networks; the network parameters are learned from a collection of videos, typically using gradient descent-based methods. This is an offline, continuous, numerical optimization strategy. Having analyzed these two strategies, both conceptually and with concrete schemes, this paper suggests investigating hybrid-optimization video coding, that is to combine online and offline, discrete and continuous, search-based and numerical optimization. For instance, we propose a hybrid-optimization video coding scheme, where the decoder consists of trained neural networks and supports several coding modes, and the encoder adopts both numerical and search-based algorithms for the online optimization. Our scheme achieves promising compression efficiency on par with H.265/HM for the random-access configuration.
Keyword:
Hybrid optimization
numerical optimization
offline optimization
online optimization
rate-distortion optimization
search-based optimization
video coding

期刊

ACM Computing Surveys 封面图
ACM Computing Surveys
IF:
28
论文数:
2.4K
被引数:
3.5W

机构

U
university of science & technology of china, cas
学者数:
3.2W
论文数: 2.7W
被引数: 74
C
chinese academy of sciences
学者数:
56.6W
论文数: 44.9W
被引数: 704