.png){kind=icon}
返回
.png){kind=icon}
.png){kind=icon}
摘要
En 中文
We present a generative neural network that enables us to generate plausible 3D indoor scenes in large quantities and varieties, easily and highly efficiently. Our key observation is that indoor scene structures are inherently hierarchical. Hence, our network is not convolutional; it is a recursive neural network, or RvNN. Using a dataset of annotated scene hierarchies, we train a variational recursive autoencoder, or RvNN-VAE, which performs scene object grouping during its encoding phase and scene generation during decoding. Specifically, a set of encoders are recursively applied to group 3D objects based on support, surround, and co-occurrence relations in a scene, encoding information about objects' spatial properties, semantics, and relative positioning with respect to other objects in the hierarchy. By training a variational autoencoder (VAE), the resulting fixed-length codes roughly follow a Gaussian distribution. A novel 3D scene can be generated hierarchically by the decoder from a randomly sampled code from the learned distribution. We coin our method GRAINS, for Generative Recursive Autoencoders for INdoor Scenes. We demonstrate the capability of GRAINS to generate plausible and diverse 3D indoor scenes and compare with existing methods for 3D scene synthesis. We show applications of GRAINS including 3D scene modeling from 2D layouts, scene editing, and semantic scene segmentation via PointNet whose performance is boosted by the large quantity and variety of 3D scenes generated by our method.
Keyword:
3D indoor scene generation
recursive neural network
variational autoencoder
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
9.5
论文数:
4.8K
被引数:
3.6W
机构
引用论文
Adaptive Synthesis of Indoor Scenes via Activity-Associated Object Relation Graphs基于活动关联对象关系图的室内场景自适应合成.png)
PREAI
.png){kind=icon}
分享.png){kind=icon}
收藏Molecular Basis of Filamin A-FilGAP Interaction and Its Impairment in Congenital Disorders Associated with Filamin A Mutations.png)
PLoS ONE
OAAI
PLoS ONEIF0
OAAI分享收藏Automatic Semantic Modeling of Indoor Scenes from Low-quality RGB-D Data using Contextual Information使用上下文信息从低质量rgb-d数据对室内场景进行自动语义建模
OAAI
OAAI分享收藏
查看更多内容