arrow
Return

Dynamic Scene Deblurring by Depth Guided Model

delete2020-01-01
delete33
delete
OA
AI
L
Lerenhan Li
Jinshan Pan cover
Jinshan Pan (Jinshan Pan)
W
Wei‐Sheng Lai
C
Changxin Gao
N
Nong Sang *
M
Ming–Hsuan Yang
DOI:10.1109/TIP.2020.2980173delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Dynamic scene blur is usually caused by object motion, depth variation as well as camera shake. Most existing methods usually solve this problem using image segmentation or fully end-to-end trainable deep convolutional neural networks by considering different object motions or camera shakes. However, these algorithms are less effective when there exist depth variations. In this work, we propose a deep neural convolutional network that exploits the depth map for dynamic scene deblurring. Given a blurred image, we first extract the depth map and adopt a depth refinement network to restore the edges and structure in the depth map. To effectively exploit the depth map, we adopt the spatial feature transform layer to extract depth features and fuse with the image features through scaling and shifting. Our image deblurring network thus learns to restore a clear image under the guidance of the depth map. With substantial experiments and analysis, we show that the depth information is crucial to the performance of the proposed model. Finally, extensive quantitative and qualitative evaluations demonstrate that the proposed model performs favorably against the state-of-the-art dynamic scene deblurring approaches as well as conventional depth-based deblurring algorithms.
Keywords:
Image deblurring
deep learning
scene depth
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Image Processing cover
IEEE Transactions on Image Processing
IF:
13.7
Papers:
1.0W
Citations:
8.4W

Organization

University of California System cover
University of California System
Scholars:
37.7W
Papers: 33.8W
Citations: 6.6K
G
Google Incorporated
Scholars:
3.5K
Papers: 1.8K
Citations: 8
Cited Papers

Cited Papers

err
IF0
err
err0
PREAI
err
errShare
errSave
Validation of a Model for Predicting Airtightness of Residential Units
err2015-11-01
err0
errOAAI
errHrvoje Krstic; Irena Istoka Otkovic; Goran Todorovic
errShare
errSave
Left ventricular noncompaction (LVNC) and low mitochondrial membrane potential are specific for Barth syndrome
err2013-01-30
err0
errOAAI
errAgnieszka Karkucinska‐Wieckowska; Joanna Trubicka; Bozena Werner; Katarzyna Kokoszynska; Magdalena Pajdowska; Maciej Pronicki; Elzbieta Czarnowska; Magdalena Lebiedzinska; Jolanta Sykut‐Cegielska; Lidia Ziolkowska; Weronika Jaron; Anna Dobrzanska; Elzbieta Ciara; Mariusz R. Wieckowski; Ewa Pronicka
errShare
errSave
errShare
errSave
Oligomycin and antimycin A prevent nitric oxide–induced apoptosis by blocking cytochrome C leakage
err2004-03-01
err0
PREAI
errNaohiro Dairaku; Katsuaki Kato; Kennichi Honda; Tomoyuki Koike; Katsunori Iijima; Akira Imatani; Hitoshi Sekine; Shuichi Ohara; Hiroshi Matsui; Tooru Shimosegawa
errShare
errSave
researcher View more