arrow
返回

Learning to Remove Shadows from a Single Image

delete2023-06-09
delete1
PRE
AI
H
Hao Jiang
Q
Qing Zhang *
聂
聂勇伟 (Yongwei Nie)
朱磊 封面图
朱磊 (Lei Zhu)
W
Wei‐Shi Zheng
DOI:10.1007/s11263-023-01823-9delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Recent learning-based shadow removal methods have achieved remarkable performance. However, they basically require massive paired shadow and shadow-free images for model training, which limits their generalization capability since these data are often cumbersome to obtain and lack of diversity. To address the problem, we present Self-ShadowGAN, a novel adversarial framework that is able to learn to remove shadows in an image by training solely on the image itself, using the shadow mask as the only supervision. Our approach is built upon the concept of histogram matching, by constraining the deshadowed regions produced by a shadow relighting network share similar histograms to the original shadow-free regions via a histogram-based discriminator. In order to speed up the single image training, we define the shadow relighting network to be lightweight multi-layer perceptions (MLPs) that estimate spatially-varying shadow relighting coefficients, where the parameters of the MLPs are predicted from a low-resolution input by a fast convolutional network and then upsampled back to the original full-resolution. Experimental results show that our method performs favorably against the state-of-the-art shadow removal methods, and is effective to process previously challenging shadow images.
Keyword:
Shadow removal
Image relighting
Generative adversarial network (GAN)

期刊

International Journal of Computer Vision 封面图
International Journal of Computer Vision
IF:
9.3
论文数:
3.9K
被引数:
2.8W

机构

S
Sun Yat Sen University
学者数:
9.9W
论文数: 7.2W
被引数: 95
H
Hong Kong University of Science and Technology (Guangzhou)
学者数:
1.0K
论文数: 866
被引数: 1
S
south china university of technology
学者数:
6.8W
论文数: 5.1W
被引数: 85
学者 查看更多机构
引用论文

引用论文

Tissue Probability-Based Attenuation Correction for Brain PET/MR by Using SPM8
err2016-10-01
err0
PREAI
errJ. Teuho; J. Linden; J. Johansson; J. Tuisku; T. Tuokkola; M. Teras
err分享
err收藏
err分享
err收藏
A theoretical individual-based model of Brown Ring Disease in Manila clams, Venerupis philippinarum
err2014-08-01
err0
errOAAI
errChristine Paillard; Fred Jean; Susan E. Ford; Eric N. Powell; John M. Klinck; Eileen E. Hofmann; Jonathan Flye-Sainte-Marie
err分享
err收藏
Deep Bilateral Learning for Real-Time Image Enhancement用于实时图像增强的深度双边学习
err2017-07-20
err565
errOAAI
errGharbi, Michael; Chen, Jiawen; Barron, Jonathan T.; Hasinoff, Samuel W.; Durand, Fredo
err分享
err收藏
SES affects infant cognitive flexibility
err2012-02-01
err0
PREAI
errMelissa W. Clearfield; Laura C. Niman
err分享
err收藏
学者 查看更多内容