arrow
Return

GRASS: Generative Recursive Autoencoders for Shape Structures

delete2017-07-20
delete322
PRE
AI
J
Jun Li
K
Kai Xu *
E
Ersin Yumer
H
Hao Zhang
L
Leonidas Guibas
DOI:10.1145/3072959.3073637delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
We introduce a novel neural network architecture for encoding and synthesis of 3D shapes, particularly their structures. Our key insight is that 3D shapes are effectively characterized by their hierarchical organization of parts, which reflects fundamental intra-shape relationships such as adjacency and symmetry. We develop a recursive neural net (RvNN) based autoencoder to map a flat, unlabeled, arbitrary part layout to a compact code. The code effectively captures hierarchical structures of man-made 3D objects of varying structural complexities despite being fixed-dimensional: an associated decoder maps a code back to a full hierarchy. The learned bidirectional mapping is further tuned using an adversarial setup to yield a generative model of plausible structures, from which novel structures can be sampled. Finally, our structure synthesis framework is augmented by a second trained module that produces fine-grained part geometry, conditioned on global and local structural context, leading to a full generative pipeline for 3D shapes. We demonstrate that without supervision, our network learns meaningful structural hierarchies adhering to perceptual grouping principles, produces compact codes which enable applications such as shape classification and partial matching, and supports shape synthesis and interpolation with significant variations in topology and geometry.
Keywords:
analysis and synthesis of shape structures
symmetry hierarchy
recursive neural network
autoencoder
generative recursive autoencoder
generative adversarial training
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

ACM Transactions on Graphics cover
ACM Transactions on Graphics
IF:
9.5
Papers:
4.8K
Citations:
3.6W

Organization

A
adobe systems inc.
Scholars:
273
Papers: 305
Citations: 0
S
Simon Fraser University
Scholars:
1.0W
Papers: 1.0W
Citations: 1.4W
I
indian institute of technology system (iit system)
Scholars:
9.5W
Papers: 9.9W
Citations: 93
I
indian institute of technology (iit) - bombay
Scholars:
6.0K
Papers: 5.6K
Citations: 0
N
national university of defense technology - china
Scholars:
1.8W
Papers: 1.4W
Citations: 9
researcher View more organizations
Cited Papers

Cited Papers

Capacitance bridge detector and signal lock for ion cyclotron resonance spectrometry
err1987-08-01
err0
PREAI
errJeffrey Marks; Paul S. Drzaic; Robert F. Foster; Donna M. Wetzel; John I. Brauman; Jack S. Uppal; Ralph H. Staley
errShare
errSave
Quantitative trait locus analyses of ozone-induced grain yield reduction in rice
err2013-04-01
err0
PREAI
errKeita Tsukahara; Hiroko Sawada; Hideyuki Matsumura; Yoshihisa Kohno; Masanori Tamaoki
errShare
errSave
Probabilistic Reasoning for Assembly-Based 3D Modeling
err2011-07-25
err150
PREAI
errChaudhuri, Siddhartha; Kalogerakis, Evangelos; Guibas, Leonidas; Koltun, Vladlen
errShare
errSave
err
IF0
err
err0
PREAI
err
errShare
errSave
Exploration of Continuous Variability in Collections of 3D Shapes
err2011-07-25
err95
PREAI
errOvsjanikov, Maks; Li, Wilmot; Guibas, Leonidas; Mitra, Niloy J.
errShare
errSave
Meta-representation of Shape Families
err2014-07-27
err36
errOAAI
errFish, Noa; Averkiou, Melinos; Van Kaick, Oliver; Sorkine-Hornung, Olga; Cohen-Or, Daniel; Mitra, Niloy J.
errShare
errSave
researcher View more