.png){kind=icon}
返回
ShapeAssembly: Learning to Generate Programs for 3D Shape Structure Synthesis
.png){kind=icon}
OA
AI
DOI：10.1145/3414685.3417812.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Manually authoring 3D shapes is difficult and time consuming; generative models of 3D shapes offer compelling alternatives. Procedural representations are one such possibility: they offer high-quality and editable results but are difficult to author and often produce outputs with limited diversity. On the other extreme are deep generative models: given enough data, they can learn to generate any class of shape but their outputs have artifacts and the representation is not editable. In this paper, we take a step towards achieving the best of both worlds for novel 3D shape synthesis. First, we propose SHAPEASSEMBLY, a domain-specific assembly-language for 3D shape structures. SHAPEASSEMBLY programs construct shape structures by declaring cuboid part proxies and attaching them to one another, in a hierarchical and symmetrical fashion. SHAPEASSEMBLY functions are parameterized with continuous free variables, so that one program structure is able to capture a family of related shapes. We show how to extract SHAPEASSEMBLY programs from existing shape structures in the PartNet dataset. Then, we train a deep generative model, a hierarchical sequence VAE, that learns to write novel SHAPEASSEMBLY programs. Our approach leverages the strengths of each representation: the program captures the subset of shape variability that is interpretable and editable, and the deep generative model captures variability and correlations across shape collections that is hard to express procedurally. We evaluate our approach by comparing the shapes output by our generated programs to those from other recent shape structure synthesis models. We find that our generated shapes are more plausible and physically-valid than those of other methods. Additionally, we assess the latent spaces of these models, and find that ours is better structured and produces smoother interpolations. As an application, we use our generative model and differentiable program interpreter to infer and fit shape programs to unstructured geometry, such as point clouds.
Keyword:
Shape analysis
shape synthesis
generative models
deep learning
procedural modeling
neurosymbolic models
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
9.5
论文数:
4.8K
被引数:
3.6W
机构
引用论文
分享收藏Rare variant
MX1
alleles increase human susceptibility to zoonotic H7N9 influenza virus.png)
Science
ScienceIF0
PREAI
分享收藏Multi-Criteria Analysis, Evaluation and Modeling of Future Scenario for the Energy Generation Sector — A Case Study能源发电部门未来情景的多标准分析、评估和建模 -- 案例研究
PREAI
分享收藏
查看更多内容