arrow
返回

Refined-mask guided multi-stream blending network

delete2023-12-12
delete0
PRE
AI
王
王硕 (Shuo Wang)
W
Weijie Lv
X
Xinyuan Zhao
X
Xinyu Zhang
J
Junyu Su
L
Long Zeng *
DOI:10.1007/s11042-023-17793-6delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Image composition is a challenging image editing operation that targets the compositing of a new image by combining cropped regions from different images. A common application is background replacement of portrait images. Existing composition methods usually result in undesirable artifacts along the boundaries of pasted regions due to imprecise extraction. To address this problem, we propose a refined-mask guided multi-stream blending network (MGMB-Net), which consists of a multi-stream block (MSB), reconstructing the foreground boundary of composited image, mask-refine blocks (MRBs), providing better location information and refined-mask guided blocks (MGBs), guiding the reconstruction of composited image to eliminate boundary artifacts. MGMB-Net can generate more harmonious and realistic images by fusing multi-stream features and refining input coarse masks. We propose two data-generation methods to construct new datasets on image blending, and two evaluation metrics, PSNR (Peak signal-to-noise ratio)-Sobel and PSNR-Boundary, to decouple the performance of blending and harmonization. Compared with state-of-the-art methods, our method achieves the best performance on portrait images without additional refinements or prior information. Our code and model are available at https://github.com/Wekect/MGMB-Net.
Keyword:
Image blending
Image composition
Boundary artifacts
Mask refine

期刊

Multimedia Tools and Applications 封面图
Multimedia Tools and Applications
IF:
3
论文数:
2.0W
被引数:
3.2W

机构

T
tsinghua university
学者数:
11.9W
论文数: 10.0W
被引数: 137
T
Tsinghua Shenzhen International Graduate School
学者数:
6.8K
论文数: 4.9K
被引数: 9
引用论文

引用论文

Mixed Lubrication Analyses by a Macro-Micro Approach and a Full-Scale Mixed EHL Model
err2004-01-13
err0
PREAI
errQ. Jane Wang; Dong Zhu; Herbert S. Cheng; Tonghui Yu; Xiaofei Jiang; Shuangbiao Liu
err分享
err收藏
err分享
err收藏
Simulation of the influence of a fine-scale urban underlying surface on the urban heat island effect in Beijing
err2021-11-01
err0
PREAI
errTian Liang; Jianjun He; Liang Chen; Zhangyu Yao; Lei Zhang; Huizheng Che; Sunling Gong
err分享
err收藏
Implications of extreme events on the water balance in Java
err2021-01-01
err0
errOAAI
errIndah Susanti; Sinta Berliana Sipayung; Bambang Siswanto; Edy Maryadi; Hidayatul Latifah; Amalia Nurlatifah; Lilik S. Supriatin; Adi Witono; Mamat Suhermat
err分享
err收藏
Comparison of Two Different Models to Predict Fall Risk in Hospitalized Patients比较两种不同模型对住院患者跌倒风险的预测
err2022-01-01
err0
errOAAI
errChad Carroll; Lea Ann Arnold; Bill Eberlein; Christa Westenberger; Kathryn Colfer; Andrew M. Naidech; Kristin Ramsey; Cord Sturgeon
err分享
err收藏
Symbolic Interaction Theory and Architecture
err2011-12-22
err0
errOAAI
errRonald W. Smith; Valerie Bugni
err分享
err收藏
学者 查看更多内容