arrow
返回

A Decoupled Multi-Task Network for Shadow Removal

delete2023-01-01
delete7
PRE
AI
J
Jiawei Liu
Q
Qiang Wang
H
Huijie Fan *
李文涛 封面图
李文涛 (Wentao Li)
L
Liangqiong Qu
Y
Yandong Tang
DOI:10.1109/TMM.2023.3252271delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Shadow removal, which aims to restore the illumination in shadow regions, is challenging due to the diversity of shadows in terms of location, intensity, shape, and size. Different from most multi-task methods, which design elaborate multi-branch or multi-stage structures for better shadow removal, we introduce feature decomposition to learn better feature representations. Specifically, we propose a single-stage and decoupled multi-task network (DMTN) to explicitly learn the decomposed features for shadow removal, shadow matte estimation, and shadow image reconstruction. First, we propose several coarse-to-fine semi-convolution (SMC) modules to capture features sufficient for joint learning of these three tasks. Second, we design a theoretically supported feature decoupling layer to explicitly decouple the learned features into shadow image features and shadow matte features via weight reassignment. Last, these features are converted to a target shadow-free image, affiliated shadow matte, and shadow image, supervised by multi-task joint loss functions. With multi-task collaboration, DMTN effectively recovers the illumination in shadow areas while ensuring the fidelity of non-shadow areas. Experimental results show that DMTN competes favorably with state-of-the-art multi-branch/multi-stage shadow removal methods, while maintaining the simplicity of single-stage methods.
Keyword:
Decomposition
feature decoupling
illumination compensation
multi-task
shadow removal

期刊

IEEE Transactions on Multimedia 封面图
IEEE Transactions on Multimedia
IF:
9.7
论文数:
4.6K
被引数:
2.4W

机构

U
university of chinese academy of sciences, cas
学者数:
4.1W
论文数: 3.8W
被引数: 75
C
chinese academy of sciences
学者数:
56.7W
论文数: 45.0W
被引数: 704
引用论文

引用论文

err分享
err收藏
Synthesis and Characterization of Cerium(IV) Metallocenes
err2015-12-11
err0
errOAAI
errAndrew Sutton; David Clark; Brian Scott; John Gordon
err分享
err收藏
学者 查看更多内容