arrow
Return

Co-occurrence based texture synthesis

delete2022-06-01
delete3
delete
OA
AI
D
Darzi, Anna
I
Itai Lang
T
Taklikar, Ashutosh
H
Hadar Averbuch‐Elor *
A
Avidan, Shai
DOI:10.1007/s41095-021-0243-7delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
As image generation techniques mature, there is a growing interest in explainable representations that are easy to understand and intuitive to manipulate. In this work, we turn to co-occurrence statistics, which have long been used for texture analysis, to learn a controllable texture synthesis model. We propose a fully convolutional generative adversarial network, conditioned locally on co-occurrence statistics, to generate arbitrarily large images while having local, interpretable control over texture appearance. To encourage fidelity to the input condition, we introduce a novel differentiable co-occurrence loss that is integrated seamlessly into our framework in an end-to-end fashion. We demonstrate that our solution offers a stable, intuitive, and interpretable latent representation for texture synthesis, which can be used to generate smooth texture morphs between different textures. We further show an interactive texture tool that allows a user to adjust local characteristics of the synthesized texture by directly using the co-occurrence values.
Keywords:
co-occurrence
texture synthesis
deep learning
generative adversarial networks (GANs)

Journal

Computational Visual Media cover
Computational Visual Media
IF:
18.3
Papers:
310
Citations:
2.6K

Organization

T
Tel Aviv University
Scholars:
3.7W
Papers: 3.0W
Citations: 3.6W
C
Cornell University
Scholars:
6.3W
Papers: 5.4W
Citations: 10.9W