arrow
Return

ParSEL: Parameterized Shape Editing with Language

delete2024-11-19
delete0
delete
OA
AI
A
Aditya Ganeshan *
R
Ryan Yuki Huang
X
X. P. Xu
R
R. Kenny Jones
D
Daniel Ritchie
DOI:10.1145/3687922delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The ability to edit 3D assets with natural language presents a compelling paradigm to aid in the democratization of 3D content creation. However, while natural language is often effective at communicating general intent, it is poorly suited for specifying exact manipulation. To address this gap, we introduce PARSEL, a system that enables controllable editing of high-quality 3D assets with natural language. Given a segmented 3D mesh and an editing request, PARSEL produces a parameterized editing program. Adjusting these parameters allows users to explore shape variations with exact control over the magnitude of the edits. To infer editing programs which align with an input edit request, we leverage the abilities of large-language models (LLMs). However, we find that although LLMs excel at identifying the initial edit operations, they often fail to infer complete editing programs, resulting in outputs that violate shape semantics. To overcome this issue, we introduce ANALYTICAL EDIT PROPAGATION (AEP), an algorithm which extends a seed edit with additional operations until a complete editing program has been formed. Unlike prior methods, AEP searches for analytical editing operations compatible with a range of possible user edits through the integration of computer algebra systems for geometric analysis. Experimentally, we demonstrate PARSEL's effectiveness in enabling controllable editing of 3D objects through natural language requests over alternative system designs.
Keywords:
Shape Editing
Parametric Editing
Large Language Models
Computer Algebra Systems
Neuro-Symbolic Methods
Program Synthesis

Journal

ACM Transactions on Graphics cover
ACM Transactions on Graphics
IF:
9.5
Papers:
4.7K
Citations:
3.6W

Organization

B
Brown University
Scholars:
2.4W
Papers: 2.2W
Citations: 3.2W