.png){kind=icon}
返回
DepthGAN: GAN-based depth generation from semantic layouts
.png){kind=icon}
OA
AI
DOI：10.1007/s41095-023-0350-8.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Existing GAN-based generative methods are typically used for semantic image synthesis. We pose the question of whether GAN-based architectures can generate plausible depth maps and find that existing methods have difficulty in generating depth maps which reasonably represent 3D scene structure due to the lack of global geometric correlations. Thus, we propose DepthGAN, a novel method of generating a depth map using a semantic layout as input to aid construction, and manipulation of well-structured 3D scene point clouds. Specifically, we first build a feature generation model with a cascade of semantically-aware transformer blocks to obtain depth features with global structural information. For our semantically aware transformer block, we propose a mixed attention module and a semantically aware layer normalization module to better exploit semantic consistency for depth features generation. Moreover, we present a novel semantically weighted depth synthesis module, which generates adaptive depth intervals for the current scene. We generate the final depth map by using a weighted combination of semantically aware depth weights for different depth ranges. In this manner, we obtain a more accurate depth map. Extensive experiments on indoor and outdoor datasets demonstrate that DepthGAN achieves superior results both quantitatively and visually for the depth generation task.
Keyword:
depth map generation
generative model
transformer
scene generation
期刊
IF:
18.3
论文数:
316
被引数:
2.6K
机构
引用论文
Influence of duration of focal cerebral ischemia and neuronal nitric oxide synthase on translocation of apoptosis-inducing factor to the nucleus.png)
Neuroscience
OAAI
NeuroscienceIF0
OAAI分享收藏Vagus nerve stimulation modulates cortical synchrony and excitability through the activation of muscarinic receptorsNeuroscienceOAAI
NeuroscienceIF0
OAAI分享收藏Inflexibility of mental planning: A characteristic disorder with prefrontal lobe lesions?心理计划的僵化: 前额叶病变的特征性障碍？
PREAI
分享收藏Work from anywhere: traditional workation, coworkation and workation retreats: a conceptual review
PREAI
分享收藏Metal-organic chemical vapor deposition of indium selenide films using a single-source precursor使用单源前体对硒化铟薄膜进行金属有机化学气相沉积
PREAI
分享收藏
查看更多内容