arrow
返回

Conditional Generative ConvNets for Exemplar-Based Texture Synthesis

delete2021-01-01
delete11
delete
OA
AI
Z
Zi-Ming Wang
M
Menghan Li
G
Gui-Song Xia *
DOI:10.1109/TIP.2021.3052075delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
The goal of exemplar-based texture synthesis is to generate texture images that are visually similar to a given exemplar. Recently, promising results have been reported by methods relying on convolutional neural networks (ConvNets) pretrained on large-scale image datasets. However, these methods have difficulties in synthesizing image textures with non-local structures and extending to dynamic or sound textures. In this article, we present a conditional generative ConvNet (cgCNN) model which combines deep statistics and the probabilistic framework of generative ConvNet (gCNN) model. Given a texture exemplar, cgCNN defines a conditional distribution using deep statistics of a ConvNet, and synthesizes new textures by sampling from the conditional distribution. In contrast to previous deep texture models, the proposed cgCNN does not rely on pre-trained ConvNets but learns the weights of ConvNets for each input exemplar instead. As a result, cgCNN can synthesize high quality dynamic, sound and image textures in a unified manner. We also explore the theoretical connections between our model and other texture models. Further investigations show that the cgCNN model can be easily generalized to texture expansion and inpainting. Extensive experiments demonstrate that our model can achieve better or at least comparable results than the state-of-the-art methods.
Keyword:
Adaptation models
Image texture
Heuristic algorithms
Probabilistic logic
Maximum likelihood estimation
Generators
Feature extraction
Texture synthesis
deep neural networks
generative model
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Image Processing 封面图
IEEE Transactions on Image Processing
IF:
13.7
论文数:
1.0W
被引数:
8.4W

机构

U
Universite Paris Cite
学者数:
8.9W
论文数: 6.3W
被引数: 604
W
wuhan university
学者数:
8.1W
论文数: 5.8W
被引数: 70
引用论文

引用论文

err分享
err收藏
Learning the Synthesizability of Dynamic Texture Samples
err2019-05-01
err5
errOAAI
errYang, Feng; Xia, Gui-Song; Dai, Dengxin; Zhang, Liangpei
err分享
err收藏
Image Melding: Combining Inconsistent Images using Patch-based Synthesis
err2012-07-01
err208
PREAI
errDarabi, Soheil; Shechtman, Eli; Barnes, Connelly; Goldman, Dan B.; Sen, Pradeep
err分享
err收藏
学者 查看更多内容