arrow
返回

A Universal Optimization Framework for Learning-based Image Codec

delete2023-08-25
delete6
delete
OA
AI
J
Jing Zhao *
B
Bin Li
J
Jiahao Li
R
Ruiqin Xiong
Y
Yan Lu
DOI:10.1145/3580499delete
delete原文链接
delete分享
delete收藏
摘要

摘要

En 中文
Recently, machine learning-based image compression has attracted increasing interests and is approaching the state-of-the-art compression ratio. But unlike traditional codec, it lacks a universal optimization method to seek efficient representation for different images. In this paper, we develop a plug-and-play optimization framework for seeking higher compression ratio, which can be flexibly applied to existing and potential future compression networks. To make the latent representation more efficient, we propose a novel latent optimization algorithm to adaptively remove the redundancy for each image. Additionally, inspired by the potential of side information for traditional codecs, we introduce side information into our framework, and integrate side information optimization with latent optimization to further enhance the compression ratio. In particular, with the joint side information and latent optimization, we can achieve fine rate control using only single model instead of training different models for different rate-distortion trade-offs, which significantly reduces the training and storage cost to support multiple bit rates. Experimental results demonstrate that our proposed framework can remarkably boost the machine learning-based compression ratio, achieving more than 10% additional bit rate saving on three different representative network structures. With the proposed optimization framework, we can achieve 7.6% bit rate saving against the latest traditional coding standard VVC on Kodak dataset, yielding the state-of-the-art compression ratio.
Keyword:
Image compression
rate distortion optimization
universal optimization framework
machine learning

期刊

ACM Transactions on Multimedia Computing Communications and Applications 封面图
ACM Transactions on Multimedia Computing Communications and Applications
IF:
6
论文数:
2.0K
被引数:
5.4K

机构

P
peking university
学者数:
11.9W
论文数: 8.7W
被引数: 146
M
Microsoft
学者数:
3.0K
论文数: 2.7K
被引数: 7
引用论文

引用论文

err分享
err收藏
err分享
err收藏
err分享
err收藏
err分享
err收藏
Adaptive Loop Filtering for Video Coding
err2013-12-01
err155
PREAI
errTsai, Chia-Yang; Chen, Ching-Yeh; Yamakage, Tomoo; Chong, In Suk; Huang, Yu-Wen; Fu, Chih-Ming; Itoh, Takayuki; Watanabe, Takashi; Chujoh, Takeshi; Karczewicz, Marta; Lei, Shaw-Min
err分享
err收藏
Childhood Sexual Abuse: A Gender Perspective on Context and Consequences
err2004-08-01
err0
PREAI
errVictoria L. Banyard; Linda M. Williams; Jane A. Siegel
err分享
err收藏
学者 查看更多内容