.png){kind=icon}
返回
Texture Memory-Augmented Deep Patch-Based Image Inpainting
.png){kind=icon}
OA
AI
DOI：10.1109/TIP.2021.3122930.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Patch-based methods and deep networks have been employed to tackle image inpainting problem, with their own strengths and weaknesses. Patch-based methods are capable of restoring a missing region with high-quality texture through searching nearest neighbor patches from the unmasked regions. However, these methods bring problematic contents when recovering large missing regions. Deep networks, on the other hand, show promising results in completing large regions. Nonetheless, the results often lack faithful and sharp details that resemble the surrounding area. By bringing together the best of both paradigms, we propose a new deep inpainting framework where texture generation is guided by a texture memory of patch samples extracted from unmasked regions. The framework has a novel design that allows texture memory retrieval to be trained end-to-end with the deep inpainting network. In addition, we introduce a patch distribution loss to encourage high-quality patch synthesis. The proposed method shows superior performance both qualitatively and quantitatively on three challenging image benchmarks, i.e., Places, CelebA-HQ, and Paris Street-View datasets (Code will be made publicly available in https://github.com/open-mmlab/mmediting).
Keyword:
Image reconstruction
Image restoration
Training
Optimization
Interpolation
Generative adversarial networks
Semantics
Image completion
generative adversarial network
texture synthesis
期刊
IF:
13.7
论文数:
1.0W
被引数:
8.4W
机构
引用论文
Oxidative phosphorylation in guinea pig mammary gland mitochondria during various functional states
.png){kind=icon}
PREAI
分享收藏
Is SA shared or distributed in team work? An exploratory study in an intelligence analysis task
PREAI
分享收藏分享收藏Urban stormwater inundation simulation based on SWMM and diffusive overland-flow model基于SWMM和扩散流模型的城市雨水淹没模拟
PREAI
分享收藏
查看更多内容