arrow
Return

Multi-Task Learning Framework for Motion Estimation and Dynamic Scene Deblurring

delete2021-01-01
delete4
PRE
AI
H
Hyungjoo Jung
Y
Youngjung Kim
H
Hyunsung Jang
N
Namkoo Ha
K
Kwanghoon Sohn *
DOI:10.1109/TIP.2021.3113185delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Motion blur, which disturbs human and machine perceptions of a scene, has been considered an unnecessary artifact that should be removed. However, the blur can be a useful clue to understanding the dynamic scene, since various sources of motion generate different types of artifacts. Motivated by the relationship between motion and blur, we propose a motion-aware feature learning framework for dynamic scene deblurring through multi-task learning. Our multi-task framework simultaneously estimates a deblurred image and a motion field from a blurred image. We design the encoder-decoder architectures for two tasks, and the encoder part is shared between them. Our motion estimation network could effectively distinguish between different types of blur, which facilitates image deblurring. Understanding implicit motion information through image deblurring could improve the performance of motion estimation. In addition to sharing the network between two tasks, we propose a reblurring loss function to optimize the overall parameters in our multi-task architecture. We provide an intensive analysis of complementary tasks to show the effectiveness of our multi-task framework. Furthermore, the experimental results demonstrate that the proposed method outperforms the state-of-the-art deblurring methods with respect to both qualitative and quantitative evaluations.
Keywords:
Kernel
Dynamics
Task analysis
Cameras
Motion estimation
Image restoration
Estimation
Motion blur
dynamic scene deblurring
motion estimation
multi-task learning

Journal

IEEE Transactions on Image Processing cover
IEEE Transactions on Image Processing
IF:
13.7
Papers:
1.0W
Citations:
8.4W

Organization

L
lig nex1 co., ltd.
Scholars:
87
Papers: 53
Citations: 0
K
korea institute of science & technology (kist)
Scholars:
1.2W
Papers: 1.3W
Citations: 23
A
agency of defense development (add), republic of korea
Scholars:
1.3K
Papers: 1.4K
Citations: 3
Y
Yonsei University
Scholars:
4.8W
Papers: 4.6W
Citations: 5.2W
researcher View more organizations
Cited Papers

Cited Papers

err
IF0
err
err0
PREAI
err
errShare
errSave
errShare
errSave
Validation of a Model for Predicting Airtightness of Residential Units
err2015-11-01
err0
errOAAI
errHrvoje Krstic; Irena Istoka Otkovic; Goran Todorovic
errShare
errSave
Vitamin D Status Is Associated with Hepcidin and Hemoglobin Concentrations in Children with Inflammatory Bowel Disease
err2017-09-01
err0
errOAAI
errSana Syed; Ellen S. Michalski; Vin Tangpricha; Supavit Chesdachai; Archana Kumar; Jarod Prince; Thomas R. Ziegler; Parminder S. Suchdev; Subra Kugathasan
errShare
errSave
Individual distance in two species of macaque
err1964-04-01
err0
PREAI
errLeonard A. Rosenblum; I.Charles Kaufman; A.J. Stynes
errShare
errSave
researcher View more