arrow
返回

Multi-Task Learning Framework for Motion Estimation and Dynamic Scene Deblurring

delete2021-01-01
delete4
PRE
AI
H
Hyungjoo Jung
Y
Youngjung Kim
H
Hyunsung Jang
N
Namkoo Ha
K
Kwanghoon Sohn *
DOI:10.1109/TIP.2021.3113185delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Motion blur, which disturbs human and machine perceptions of a scene, has been considered an unnecessary artifact that should be removed. However, the blur can be a useful clue to understanding the dynamic scene, since various sources of motion generate different types of artifacts. Motivated by the relationship between motion and blur, we propose a motion-aware feature learning framework for dynamic scene deblurring through multi-task learning. Our multi-task framework simultaneously estimates a deblurred image and a motion field from a blurred image. We design the encoder-decoder architectures for two tasks, and the encoder part is shared between them. Our motion estimation network could effectively distinguish between different types of blur, which facilitates image deblurring. Understanding implicit motion information through image deblurring could improve the performance of motion estimation. In addition to sharing the network between two tasks, we propose a reblurring loss function to optimize the overall parameters in our multi-task architecture. We provide an intensive analysis of complementary tasks to show the effectiveness of our multi-task framework. Furthermore, the experimental results demonstrate that the proposed method outperforms the state-of-the-art deblurring methods with respect to both qualitative and quantitative evaluations.
Keyword:
Kernel
Dynamics
Task analysis
Cameras
Motion estimation
Image restoration
Estimation
Motion blur
dynamic scene deblurring
motion estimation
multi-task learning

期刊

IEEE Transactions on Image Processing 封面图
IEEE Transactions on Image Processing
IF:
13.7
论文数:
1.0W
被引数:
8.4W

机构

L
lig nex1 co., ltd.
学者数:
87
论文数: 53
被引数: 0
K
korea institute of science & technology (kist)
学者数:
1.2W
论文数: 1.3W
被引数: 23
A
agency of defense development (add), republic of korea
学者数:
1.3K
论文数: 1.4K
被引数: 3
Y
Yonsei University
学者数:
4.8W
论文数: 4.6W
被引数: 5.2W
学者 查看更多机构
引用论文

引用论文

err
IF0
err
err0
PREAI
err
err分享
err收藏
err分享
err收藏
Validation of a Model for Predicting Airtightness of Residential Units
err2015-11-01
err0
errOAAI
errHrvoje Krstic; Irena Istoka Otkovic; Goran Todorovic
err分享
err收藏
Vitamin D Status Is Associated with Hepcidin and Hemoglobin Concentrations in Children with Inflammatory Bowel Disease
err2017-09-01
err0
errOAAI
errSana Syed; Ellen S. Michalski; Vin Tangpricha; Supavit Chesdachai; Archana Kumar; Jarod Prince; Thomas R. Ziegler; Parminder S. Suchdev; Subra Kugathasan
err分享
err收藏
Individual distance in two species of macaque
err1964-04-01
err0
PREAI
errLeonard A. Rosenblum; I.Charles Kaufman; A.J. Stynes
err分享
err收藏
学者 查看更多内容