arrow
返回

Advanced Scalability for Light Field Image Coding

delete2022-01-01
delete4
delete
OA
AI
H
Hadi Amirpour *
C
Christine Guillemot
M
M. Ghanbari
C
Christian Timmerer
DOI:10.1109/TIP.2022.3223787delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Light field imaging, which captures both spatial and angular information, improves user immersion by enabling post-capture actions, such as refocusing and changing view perspective. However, light fields represent very large volumes of data with a lot of redundancy that coding methods try to remove. State-of-the-art coding methods indeed usually focus on improving compression efficiency and overlook other important features in light field compression such as scalability. In this paper, we propose a novel light field image compression method that enables (i) viewport scalability, (ii) quality scalability, (iii) spatial scalability, (iv) random access, and (v) uniform quality distribution among viewports, while keeping compression efficiency high. To this end, light fields in each spatial resolution are divided into sequential viewport layers, and viewports in each layer are encoded using the previously encoded viewports. In each viewport layer, the available viewports are used to synthesize intermediate viewports using a video interpolation deep learning network. The synthesized views are used as virtual reference images to enhance the quality of intermediate views. An image super-resolution method is applied to improve the quality of the lower spatial resolution layer. The super-resolved images are also used as virtual reference images to improve the quality of the higher spatial resolution layer. The proposed structure also improves the flexibility of light field streaming, provides random access to the viewports, and increases error resiliency. The experimental results demonstrate that the proposed method achieves a high compression efficiency and it can adapt to the display type, transmission channel, network condition, processing power, and user needs.
Keyword:
Light field
compression
scalability
random access
deep learning

期刊

IEEE Transactions on Image Processing 封面图
IEEE Transactions on Image Processing
IF:
13.7
论文数:
1.0W
被引数:
8.4W

机构

U
universite de rennes
学者数:
1.7W
论文数: 1.3W
被引数: 30
U
University of Klagenfurt
学者数:
946
论文数: 1.0K
被引数: 1.0K
引用论文

引用论文

Crystallization of a photosensitive nitrile hydratase from Rhodococcus sp. N-771
err1991-07-01
err0
PREAI
errTeruyuki Nagamune; Jun Honda; Won-Dai Cho; Nobuo Kamiya; Yoshitaka Teratani; Akira Hirata; Hiroyuki Sasabe; Isao Endo
err分享
err收藏
err分享
err收藏
Second-Order Hyperpolarizabilities of Stilbazolium Cations Studied by Semiempirical Calculation
err1996-11-07
err0
PREAI
errXuan-Ming Duan; Hideo Konami; Shuji Okada; Hidetoshi Oikawa; Hiro Matsuda; Hachiro Nakanishi
err分享
err收藏
Light field image coding with flexible viewpoint scalability and random access
err2021-05-01
err8
errOAAI
errMonteiro, Ricardo J. S.; Rodrigues, Nuno M. M.; Faria, Sergio M. M.; Nunes, Paulo J. L.
err分享
err收藏
Melatonin reduces arousal and startle responsiveness without influencing startle habituation or affective startle modulation in young women
err2008-07-01
err0
PREAI
errHartmut Schachinger; Terry D. Blumenthal; Steffen Richter; Egemen Savaskan; Anna Wirz-Justice; Kurt Kräuchi
err分享
err收藏
Shearlet Transform-Based Light Field Compression Under Low Bitrates低比特率下基于Shearlet变换的光场压缩
err2020-01-01
err31
errOAAI
errAhmad, Waqas; Vagharshakyan, Suren; Sjostrom, Marten; Gotchev, Atanas; Bregovic, Robert; Olsson, Roger
err分享
err收藏
Coded exposure photography
err2006-01-01
err0
PREAI
errRamesh Raskar; Amit Agrawal; Jack Tumblin
err分享
err收藏
学者 查看更多内容