arrow
返回

Learning Adaptive Patch Generators for Mask-Robust Image Inpainting

delete2023-01-01
delete7
PRE
AI
W
Wanhua Li
Y
Yueqi Duan
周
周杰 (Jie Zhou)
J
Jiwen Lu *
DOI:10.1109/TMM.2022.3174413delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
In this paper, we propose a Mask-Robust Inpainting Network (MRIN) approach to recover the masked areas of an image. Most existing methods learn a single model for image inpainting, under a basic assumption that all masks are from the same type. However, we discover that the masks are usually complex and exhibit various shapes and sizes at different locations of an image, where a single model cannot fully capture the large domain gap across different masks. To address this, we learn to decompose a complex mask area into several basic types and recover the damaged image in a patch-wise manner with a type-specific generator. More specifically, our MRIN consists of a mask-robust agent and an adaptive patch generative network. The mask-robust agent contains a mask selector and a patch locator, which generates mask attention maps to select a patch at each step. Based on the predicted mask attention maps, the adaptive patch generative network inpaints the selected patch with the generators bank, so that it sequentially inpaints each patch with different patch generators according to its mask type. Extensive experiments demonstrate that our approach outperforms most state-of-the-art approaches on the Place2, CelebA, and Paris Street View datasets.
Keyword:
Image inpainting
mask-robust agent
adaptive patch generators

期刊

IEEE Transactions on Multimedia 封面图
IEEE Transactions on Multimedia
IF:
9.7
论文数:
4.6K
被引数:
2.4W

机构

T
tsinghua university
学者数:
11.9W
论文数: 10.0W
被引数: 137
引用论文

引用论文

Embedded Generation
err
IF0
err2000-01-01
err0
PREAI
errN. Jenkins; et al.
err分享
err收藏
err分享
err收藏
Recurrent Generative Adversarial Network for Face Completion
err2021-01-01
err29
PREAI
errWang, Qiang; Fan, Huijie; Sun, Gan; Ren, Weihong; Tang, Yandong
err分享
err收藏
Analysis on smart material suitable for autogenous microelectronic application
err2019-08-30
err0
PREAI
errR Sitharthan; Manimaran Ponnusamy; Madurakavi Karthikeyan; D Shanmuga Sundar
err分享
err收藏
学者 查看更多内容