arrow
Return

Image Compression-Aware Deep Camera ISP Network

delete2021-01-01
delete3
delete
OA
AI
K
Kwang-Hyun Uhm
K
Kyuyeon Choi
S
Seung‐Won Jung *
S
Sung-Jea Ko
DOI:10.1109/ACCESS.2021.3116702delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Several recent studies have attempted to fully replace the conventional camera image signal processing (ISP) pipeline with convolutional neural networks (CNNs). However, the previous CNN-based ISPs, simply referred to as ISP-Nets, have not explicitly considered that images have to be lossy-compressed in most cases, especially by the off-the-shelf JPEG. To address this issue, in this paper, we propose a novel compression-aware deep camera ISP learning framework. At first, we introduce a new use case of compression artifacts simulation network (CAS-Net), which operates in the opposite way of commonly used compression artifacts reduction networks. Then, the CAS-Net is connected with an ISP-Net such that the ISP network can be trained with consideration of image compression. Throughout experimental studies, we show that our compression-aware camera ISP network can produce images with a better tradeoff between bit-rate and image quality compared to its compression-agnostic version when the performance is evaluated after JPEG compression.
Keywords:
Image coding
Transform coding
Cameras
Training
Pipelines
Task analysis
Noise reduction
Camera ISP
compression artifacts
convolutional neural network
image compression

Journal

IEEE Access cover
IEEE Access
IF:
3.6
Papers:
9.8W
Citations:
29.4W

Organization

K
Korea University
Scholars:
3.6W
Papers: 3.8W
Citations: 4.4W