arrow
Return

Learning Controllable ISP for Image Enhancement

delete2024-01-01
delete1
PRE
AI
H
Heewon Kim
K
Kyoung Mu Lee *
DOI:10.1109/TIP.2023.3305816delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
We present a plug-and-play Image Signal Processor (ISP) for image enhancement to better produce diverse image styles than the previous works. Our proposed method, ContRollable Image Signal Processor (CRISP), explicitly controls the parameters of the ISP that determine output image styles. ISP parameters for high-quality (HQ) image styles are encoded into low-dimensional latent codes, allowing fast and easy style adjustments. We empirically show that CRISP covers a wide range of image styles with high efficiency. On the MIT-Adobe FiveK dataset, CRISP can very closely estimate the reference styles produced by human experts and achieves better MOS with diverse image styles. Compared with the state-of-the-art method, our ISP comprises only 19 parameters, allowing CRISP to have $2\times $ smaller parameters and $100\times $ reduced FLOPs for an image output. CRISP outperforms previous works in PSNR and FLOPs with several scenarios for style adjustments.
Keywords:
Image enhancemen
image manipulation
deep learning

Journal

IEEE Transactions on Image Processing cover
IEEE Transactions on Image Processing
IF:
13.7
Papers:
1.0W
Citations:
8.4W

Organization

S
Soongsil University
Scholars:
3.4K
Papers: 3.5K
Citations: 3.2K
S
seoul national university (snu)
Scholars:
7.2W
Papers: 6.6W
Citations: 86
Cited Papers

Cited Papers

Kinematics of cycling in relation to anterior knee pain and patellar tendinitis
err2003-01-01
err0
PREAI
errMARTIN BAILEY; FREDERICK MAILLARDET; NEIL MESSENGER
errShare
errSave
Comparison Between 1.5 and 3.0 Tesla Magnetic Resonance Enterography for the Assessment of Disease Activity and Complications in Ileo-Colonic Crohn’s Disease
err2013-08-01
err0
PREAI
errGionata Fiorino; Cristiana Bonifacio; Mauro Padrenostro; Federica Mrakic Sposta; Antonino Spinelli; Alberto Malesci; Luca Balzarini; Laurent Peyrin-Biroulet; Silvio Danese
errShare
errSave
Understanding the constitutive presentation of MHC class I immunopeptidomes in primary tissues
err2022-02-01
err0
errOAAI
errPeter Kubiniok; Ana Marcu; Leon Bichmann; Leon Kuchenbecker; Heiko Schuster; David J. Hamelin; Jérôme D. Duquette; Kevin A. Kovalchik; Laura Wessling; Oliver Kohlbacher; Hans-Georg Rammensee; Marian C. Neidert; Isabelle Sirois; Etienne Caron
errShare
errSave
Interactive local adjustment of tonal values
err2006-07-01
err305
PREAI
errLischinski, Dani; Farbman, Zeev; Uyttendaele, Matt; Szeliski, Richard
errShare
errSave
Environmental Temperature and Thermal Indices: What Is the Most Effective Predictor of Heat-Related Mortality in Different Geographical Contexts?
err2014-01-01
err0
errOAAI
errMarco Morabito; Alfonso Crisci; Alessandro Messeri; Valerio Capecchi; Pietro Amedeo Modesti; Gian Franco Gensini; Simone Orlandini
errShare
errSave
Deep Bilateral Learning for Real-Time Image Enhancement
err2017-07-20
err565
errOAAI
errGharbi, Michael; Chen, Jiawen; Barron, Jonathan T.; Hasinoff, Samuel W.; Durand, Fredo
errShare
errSave
Personal Photo Enhancement Using Example Images
err2010-04-21
err110
PREAI
errJoshi, Neel; Matusik, Wojciech; Adelson, Edward H.; Kriegman, David J.
errShare
errSave
Identification of factors associated with sedation tolerance in 5000 patients undergoing outpatient colonoscopy: Canadian tertiary center experience
err2016-01-01
err0
errOAAI
errAlexandra Shingina; George Ou; Oliver Takach; Sigrid Svarta; Ricky Kwok; Jessica Tong; Kieran Donaldson; Eric Lam; Robert Enns
errShare
errSave
researcher View more