arrow
返回

Text-Free Controllable 3-D Point Cloud Generation

delete2024-01-01
delete0
PRE
AI
H
Haihong Xiao
康
康文雄 (Wenxiong Kang) *
Y
Yuqiong Li *
H
Hongbin Xu
DOI:10.1109/TIM.2024.3353839delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Generating 3-D shapes with text inputs has long been a peculiar challenge in computer vision, which requires methodological know-how as well as a sense of art. Recently, text-to-image generation has driven remarkable progress, raising tremendous interest in text-guided shape generation, which further paves the way for industrial design. Nevertheless, prior efforts on text-guided 3-D synthesis either lack geometric details, are limited by the simple text input, or need expensive optimization and additional postprocessing, which make them unfriendly for novices. In this research, we present TFCNet, a novel approach for text-free controllable point cloud generation. In the training phase, we first design an empirically robust cross-modal skeletal point generator (CM-SPG) to predict skeletal points of the specific shape conditioned on the single image input. Then, we develop a diffusion-based dense point generator, which takes skeletal points as geometric guidance to produce dense point clouds that are faithful to the input images. In the inference phase, we propose an efficient text-free nonparametric transfer regime, which does not require separate training and can directly generate point cloud shapes while being semantically faithful to the provided text input. As evidenced by our experiments on the ShapeNet(v2) and CO3D datasets, our proposed method outperforms existing state of-the-art methods both quantitatively and qualitatively.
Keyword:
3-D point cloud
text-free controllable point cloud generation
text-guided 3-D generative modeling

期刊

IEEE Transactions on Instrumentation and Measurement 封面图
IEEE Transactions on Instrumentation and Measurement
IF:
5.9
论文数:
2.0W
被引数:
5.8W

机构

C
chinese academy of sciences
学者数:
56.7W
论文数: 45.0W
被引数: 704
S
south china university of technology
学者数:
6.8W
论文数: 5.1W
被引数: 85
引用论文

引用论文

Preparation of n-ZnO/p-Si Heterojunction by Sol-Gel Process
err1992-06-01
err0
PREAI
errTakeshi Okamura; Yoji Seki; Shoken Nagakari; Hideyo Okushi Hideyo Okushi
err分享
err收藏
Label-Free Biosensor Detection of Endocrine Disrupting Compounds Using Engineered Estrogen Receptors
err2017-12-22
err0
errOAAI
errRita La Spina; Valentina Ferrero; Venera Aiello; Mattia Pedotti; Luca Varani; Teresa Lettieri; Luigi Calzolai; Willem Haasnoot; Pascal Colpo
err分享
err收藏
Molecular karyotypes for Alternaria plant pathogens known to produce host-specific toxins
err1999-07-14
err0
PREAI
errHajime Akamatsu; Masatoki Taga; M. Kodama; Richard Johnson; Hiroshi Otani; Keisuke Kohmoto
err分享
err收藏
High-resolution genetic mapping of QTL governing resistance to corn leaf aphid, Rhopalosiphum maidis (Fitch) in barley
err2022-10-17
err0
PREAI
errBeant Singh; Dharminder Bhatia; Deepika Narang; Rajwinder Kaur; Parveen Chhuneja
err分享
err收藏
Isolation of full-length IgG antibodies from combinatorial libraries expressed in the cytoplasm ofEscherichia coli
err
IF0
err2020-05-10
err0
errOAAI
errMichael-Paul Robinson; Emily C. Cox; Mingji Li; Thapakorn Jaroentomeechai; Xiaolu Zheng; Matthew Chang; Mehmet Berkmen; Matthew P. DeLisa
err分享
err收藏
学者 查看更多内容