arrow
返回

Semantic Guided Single Image Reflection Removal

delete2022-11-01
delete0
delete
OA
AI
Y
Yunfei Liu
李煜 封面图
李煜 (Yu Li)
S
Shaodi You
F
Feng Lu *
DOI:10.1145/3510821delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Reflection is common when we see through a glass window, which not only is a visual disturbance but also influences the performance of computer vision algorithms. Removing the reflection from a single image, however, is highly ill-posed since the color at each pixel needs to be separated into two values belonging to the clear background and the reflection, respectively. To solve this, existing methods use additional priors such as reflection layer smoothness, double reflection effect, and color consistency to distinguish the two layers. However, these low-level priors may not be consistently valid in real cases. In this paper, inspired by the fact that human beings can separate the two layers easily by recognizing the objects and understanding the scene, we propose to use the object semantic cue, which is high-level information, as the guidance to help reflection removal. Based on the data analysis, we develop a multi-task end-to-end deep learning method with a semantic guidance component, to solve reflection removal and semantic segmentation jointly. Extensive experiments on different datasets show significant performance gain when using high-level object-oriented information. We also demonstrate the application of our method to other computer vision tasks.
Keyword:
Reflection removal
semantic segmentation
multi-task learning
highlevel guidance
deep learning

期刊

ACM Transactions on Multimedia Computing Communications and Applications 封面图
ACM Transactions on Multimedia Computing Communications and Applications
IF:
6
论文数:
2.0K
被引数:
5.4K

机构

U
university of amsterdam
学者数:
6.0W
论文数: 5.1W
被引数: 94
B
Beihang University
学者数:
5.2W
论文数: 4.1W
被引数: 37
I
international digital economy academy
学者数:
48
论文数: 30
被引数: 0
学者 查看更多机构
引用论文

引用论文

err分享
err收藏
A Computational Approach for Obstruction-Free Photography
err2015-07-27
err173
errOAAI
errXue, Tianfan; Rubinstein, Michael; Liu, Ce; Freeman, William T.
err分享
err收藏
Image-Based Rendering for Scenes with Reflections具有反射的场景的基于图像的渲染
err2012-07-01
err93
errOAAI
errSinha, Sudipta N.; Kopf, Johannes; Goesele, Michael; Scharstein, Daniel; Szeliski, Richard
err分享
err收藏