arrow
返回

CLAST: Contrastive Learning for Arbitrary Style Transfer

delete2022-01-01
delete8
PRE
AI
X
Xinhao Wang
W
Wenjing Wang
S
Shuai Yang
J
Jiaying Liu *
DOI:10.1109/TIP.2022.3215899delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Arbitrary style transfer aims at migrating the style of a reference style painting to a target content image. Existing methods find it challenging to achieve good content fidelity and style migration at the same time. Moreover, they all rely on manually defined content and style, which is of limited universality and robustness. In this paper, we propose to introduce contrastive learning into style transfer, instructing the network to automatically learn to model the structural content and artistic style based on natural contrastive relationships in style transfer. Compared with existing methods, our learned modeling of content and style is more robust and universal. In addition, we further propose instance-wise contrastive style losses and a patch-wise contrastive content loss to guide style transfer. Combining the proposed contrastive losses and two self-reconstruction strategies, we develop a new style transfer framework, which is pluggable and can be flexibly applied to various style transfer modules. Experimental results demonstrate that our method has strong flexibility and synthesizes stylized images with higher quality.
Keyword:
Feature extraction
Painting
Training
Neural networks
Loss measurement
Modulation
Generative adversarial networks
Style transfer
image synthesis
contrastive learning
image processing
self-supervised learning

期刊

IEEE Transactions on Image Processing 封面图
IEEE Transactions on Image Processing
IF:
13.7
论文数:
1.0W
被引数:
8.4W

机构

N
Nanyang Technological University
学者数:
4.9W
论文数: 4.8W
被引数: 8.1W
P
peking university
学者数:
11.9W
论文数: 8.7W
被引数: 146
引用论文

引用论文

err分享
err收藏
Exploring complex CIDEP ofp-benzosemiquinones with time resolved CW-EPR
err2002-05-10
err0
PREAI
errMARTIN JÄGER; BRIAN C. YU; JAMES R. NORRIS
err分享
err收藏
Zero-Shot Image Dehazing零拍图像去雾化
err2020-01-01
err112
PREAI
errLi, Boyun; Gou, Yuanbiao; Liu, Jerry Zitao; Zhu, Hongyuan; Zhou, Joey Tianyi; Peng, Xi
err分享
err收藏
Exploring the causality links between financial markets and foreign direct investment in Africa
err2013-05-01
err0
PREAI
errElikplimi Komla Agbloyor; Joshua Abor; Charles Komla Delali Adjasi; Alfred Yawson
err分享
err收藏
Differential diagnosis of bluetongue in cattle and sheep
err2008-05-01
err0
PREAI
errSusanna Williamson; Nick Woodger; Karin Darpel
err分享
err收藏
学者 查看更多内容