arrow
返回

Pre-Demosaic Graph-Based Light Field Image Compression

delete2022-01-01
delete5
delete
OA
AI
Y
Yung‐Hsuan Chao *
H
Haoran Hong
G
Gene Cheung
A
Antonio Ortega
DOI:10.1109/TIP.2022.3145242delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
An unfocused plenoptic light field (LF) camera places an array of microlenses in front of an image sensor in order to separately capture different directional rays arriving at an image pixel. Using a conventional Bayer pattern, data captured at each pixel is a single color component (R, G or B). The sensed data then undergoes demosaicking (interpolation of RGB components per pixel) and conversion to an array of sub-aperture images (SAIs). In this paper, we propose a new LF image coding scheme based on graph lifting transform (GLT), where the acquired sensor data are coded in the original captured form without pre-processing. Specifically, we directly map raw sensed color data to the SAIs, resulting in sparsely distributed color pixels on 2D grids, and perform demosaicking at the receiver after decoding. To exploit spatial correlation among the sparse pixels, we propose a novel intra-prediction scheme, where the prediction kernel is determined according to the local gradient estimated from already coded neighboring pixel blocks. We then connect the pixels by forming a graph, modeling the prediction residuals statistically as a Gaussian Markov Random Field (GMRF). The optimal edge weights are computed via a graph learning method using a set of training SAIs. The residual data is encoded via low-complexity GLT. Experiments show that at high PSNRs-important for archiving and instant storage scenarios-our method outperformed significantly a conventional light field image coding scheme with demosaicking followed by High Efficiency Video Coding (HEVC).
Keyword:
Image coding
Image color analysis
Cameras
Pipelines
Transforms
Correlation
Redundancy
Light field imaging
image compression
graph signal processing
intra-prediction
lifting transform

期刊

IEEE Transactions on Image Processing 封面图
IEEE Transactions on Image Processing
IF:
13.7
论文数:
1.0W
被引数:
8.4W

机构

U
university of southern california
学者数:
4.7W
论文数: 3.8W
被引数: 51
Y
york university - canada
学者数:
8.3K
论文数: 9.0K
被引数: 10
引用论文

引用论文

Analysis of infliximab treated pediatric patients with Crohn disease in Hungary
err2010-01-01
err0
errOAAI
errGábor Veres; Dolóresz Szabó; Ágnes Várkonyi; Beáta Tari; Marianne Polgár; Judit B. Kovács; Ágnes Horváth; Erika Tomsits; István Tokodi; Hedvig Bodánszky; Antal Dezsőfi; Erzsébet Szakos; Noémi Vass; Viktória Ruszinkó; Márta Kovács; Katalin Eszter Müller; András Arató
err分享
err收藏
err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
err分享
err收藏
Light Field Image Coding Based on Hybrid Data Representation
err2020-01-01
err7
errOAAI
errMonteiro, Ricardo J. S.; Rodrigues, Nuno M. M.; Faria, Sergio M. M.; Nunes, Paulo J. L.
err分享
err收藏
err分享
err收藏
Questionário nutricional simplificado de apetite (QNSA) para uso em programas de reabilitação cardiopulmonar e metabólica
err2012-10-01
err0
errOAAI
errSabrina Weiss Sties; Ana Inês Gonzáles; Maick da Silveira Viana; Ricardo Brandt; Renata Labronici Bertin; Ricardo Goldfeder; Anderson Zampier Ulbrich; Alexandro Andrade; Tales de Carvalho
err分享
err收藏
Changes in Inflammation and QoL After a Single Dose of Infliximab During Ongoing IBD Treatment
err2012-04-01
err0
errOAAI
errMark D. DeBoer; Barrett H. Barnes; Nicholas A. Stygles; James L. Sutphen; Stephen M. Borowitz
err分享
err收藏
Light field image coding with flexible viewpoint scalability and random access
err2021-05-01
err8
errOAAI
errMonteiro, Ricardo J. S.; Rodrigues, Nuno M. M.; Faria, Sergio M. M.; Nunes, Paulo J. L.
err分享
err收藏
Infliximab improves inflammation and anthropometric measures in pediatric Crohn's disease
err2010-03-25
err0
PREAI
errDaniel M Sinitsky; Daniel A Lemberg; Steven T Leach; Timothy D Bohane; Reuben Jackson; Andrew S Day
err分享
err收藏
学者 查看更多内容