arrow
返回

Cross-View Panorama Image Synthesis

delete2023-01-01
delete4
delete
OA
AI
S
Songsong Wu
H
Hao Tang
X
Xiao‐Yuan Jing *
H
Haifeng Zhao
J
Jianjun Qian
N
Nicu Sebe
Y
Yan Yan
DOI:10.1109/TMM.2022.3162474delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
In this paper, we tackle the problem of synthesizing a ground-view panorama image conditioned on a top-view aerial image, which is a challenging problem due to the large gap between the two image domains with different view-points. Instead of learning cross-view mapping in a feedforward pass, we propose a novel adversarial feedback GAN framework named PanoGAN with two key components: an adversarial feedback module and a dual branch discrimination strategy. First, the aerial image is fed into the generator to produce a target panorama image and its associated segmentation map in favor of model training with layout semantics. Second, the feature responses of the discriminator encoded by our adversarial feedback module are fed back to the generator to refine the intermediate representations, so that the generation performance is continually improved through an iterative generation process. Third, to pursue high-fidelity and semantic consistency of the generated panorama image, we propose a pixel-segmentation alignment mechanism under the dual branch discrimiantion strategy to facilitate cooperation between the generator and the discriminator. Extensive experimental results on two challenging cross-view image datasets show that PanoGAN enables high-quality panorama image generation with more convincing details than state-of-the-art approaches. The source code and trained models are available at https://github.com/ sswuai/ PanoGAN.
Keyword:
Generators
Image synthesis
Task analysis
Image segmentation
Feature extraction
Semantics
Generative adversarial networks
Cross-view panorama generation
feedback adversarial learning
multi-scale feature alignment
GANs

期刊

IEEE Transactions on Multimedia 封面图
IEEE Transactions on Multimedia
IF:
9.7
论文数:
4.5K
被引数:
2.4W

机构

U
University of Trento
学者数:
8.8K
论文数: 9.0K
被引数: 1.2W
I
Illinois Institute of Technology
学者数:
3.8K
论文数: 3.9K
被引数: 4.2K
S
swiss federal institutes of technology domain
学者数:
9.0W
论文数: 8.0W
被引数: 163
N
nanjing university
学者数:
7.8W
论文数: 5.6W
被引数: 87
G
Guangdong University of Petrochemical Technology
学者数:
2.0K
论文数: 1.6K
被引数: 1
学者 查看更多机构
引用论文

引用论文

err2001-01-01
err0
PREAI
errH.M. Msami; T. Ponela-Mlelwa; B.J. Mtei; A.M. Kapaga
err分享
err收藏
err分享
err收藏
A Survey on Privacy in Location-Based Services
err2014-12-01
err0
errOAAI
errMayra Zurbarán; Liliana González; Pedro Wightman Rojas; M. Labrador
err分享
err收藏
学者 查看更多内容