arrow
Return

Self-Parameter Distillation Dehazing

delete2023-01-01
delete7
PRE
AI
G
Guisik Kim
J
Junseok Kwon *
DOI:10.1109/TIP.2022.3231122delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In this paper, we propose a novel dehazing method based on self-distillation. In contrast to conventional knowledge distillation approaches that transfer large models (teacher networks) to small models (student networks), we introduce a single knowledge distillation network that transfers network parameters to itself for dehazing. In the early stages, the proposed network transfers scene content (identity) information to the next stage of itself using haze-free data. However, in the later stages, the network transfers haze information to itself using haze data, enabling the accurate dehazing of input images using scene information from the early stages. In a single network, parameters are seamlessly updated from extracting global scene features to dehazing the scene. During the training, forward propagation acts as a teacher network, whereas backward propagation acts as a student network. The experimental results demonstrate that the proposed method considerably outperforms other state-of-the-art dehazing methods.
Keywords:
Knowledge engineering
Training
Task analysis
Atmospheric modeling
Feature extraction
Backpropagation
Deep learning
Dehazing
self-distillation
deraining

Journal

IEEE Transactions on Image Processing cover
IEEE Transactions on Image Processing
IF:
13.7
Papers:
1.0W
Citations:
8.4W

Organization

C
Chung Ang University
Scholars:
1.3W
Papers: 1.4W
Citations: 133
Cited Papers

Cited Papers

Inflammatory bowel disease position statement of the Italian Society of Colorectal Surgery (SICCR): Crohn’s disease
err2020-03-14
err0
errOAAI
errG. Pellino; D. S. Keller; G. M. Sampietro; I. Angriman; M. Carvello; V. Celentano; F. Colombo; F. Di Candido; S. Laureti; G. Luglio; G. Poggioli; M. Rottoli; S. Scaringi; G. Sciaudone; G. Sica; L. Sofo; S. Leone; S. Danese; A. Spinelli; G. Delaini; F. Selvaggi
errShare
errSave
Silver Contact Grid: Inferred Contact Resistivity and Cost Minimization in 19% Silicon Solar Cells
err2013-01-01
err0
PREAI
errDaniel L. Meier; Vinodh Chandrasekaran; Atul Gupta; Vijay Yelundur; Ajeet Rohatgi
errShare
errSave
researcher View more