arrow
返回

Inactive Region Filling Method for Efficient Compression Using Reinforcement Learning

delete2023-01-01
delete0
delete
OA
AI
D
Dongsin Kim
K
Kutub Uddin
DOI:10.1109/ACCESS.2023.3296784delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Based on the massive advancements in modern hardware technologies, beyond high-resolution images, immersive and interactive videos have become an important next-generation technology. Immersive video includes 3D information having a huge number of bits. Thus, a special coding standard is required to compress immersive video e.g., 360 and point cloud videos. To compress immersive videos, the 3D information is projected into 2D space which creates several empty spaces called inactive regions. Even though the codec model can efficiently compress the immersive video, the inactive regions excessively degrade the overall performance. Recently, several model-based methods have suggested filling the inactive regions to prevent performance degradation. In this paper, we propose a novel approach to fill the inactive region using deep reinforcement learning. We perform block-wise inactive region filling in which each block has an agent, and overall pixel values are controlled by using a control point-based block-wise selective filtering method. The control point controls the pixel intensity to generate rough patterns and reduce computational complexity. In addition, each control point and the active region (attribute or pixel information) are propagated to the inactive region by considering their own information and neighboring information. Besides, each agent can learn the information of neighboring blocks with a modified rate-distortion (R-D) cost reward. We evaluate the proposed method on the sphere segmented projection (SSP), point cloud compression (PCC) attribute, and PCC geometry video formats. The proposed method achieves an average bitrate reduction of -10.9% for the SSP, -9.1% for the PCC-attribute, and -11.8% for the PCC-geometry, which are much better than the conventional method.
Keyword:
Image filling
immersive video
inactive region
reinforcement learning
video compression

期刊

IEEE Access 封面图
IEEE Access
IF:
3.6
论文数:
9.8W
被引数:
29.4W

机构

K
Korea Aerospace University
学者数:
1.1K
论文数: 1.1K
被引数: 513
引用论文

引用论文

err分享
err收藏
Embedded Generation
err
IF0
err2000-01-01
err0
PREAI
errN. Jenkins; et al.
err分享
err收藏
Point-Cloud Compression Moving Picture Experts Group's new standard in 2020
err2019-07-01
err40
PREAI
errCui, Li; Mekuria, Rufael; Preda, Marius; Jang, Euee S.
err分享
err收藏
Patterns and Etiologies of Uveitis at a Tertiary Referral Center in Taiwan
err2016-07-27
err0
PREAI
errShih-Chou Chen; Chiu-Tung Chuang; Ming-Ying Chu; Shwu-Jiuan Sheu
err分享
err收藏
Emerging MPEG Standards for Point Cloud Compression
err2019-03-01
err576
errOAAI
errSchwarz, Sebastian; Preda, Marius; Baroncini, Vittorio; Budagavi, Madhukar; Cesar, Pablo; Chou, Philip A.; Cohen, Robert A.; Krivokuca, Maja; Lasserre, Sebastien; Li, Zhu; Llach, Joan; Mammou, Khaled; Mekuria, Rufael; Nakagami, Ohji; Siahaan, Ernestasia; Tabatabai, Ali; Tourapis, Alexis M.; Zakharchenko, Vladyslav
err分享
err收藏
err分享
err收藏
err分享
err收藏
Radiation doses from small-bowel follow-through and abdomen/pelvis MDCT in pediatric Crohn disease
err2008-01-05
err0
PREAI
errAna Maria Gaca; Tracy A. Jaffe; Susan Delaney; Terry Yoshizumi; Greta Toncheva; Giao Nguyen; Donald P. Frush
err分享
err收藏
学者 查看更多内容