返回
Text-Free Controllable 3-D Point Cloud Generation
DOI:10.1109/TIM.2024.3353839.png)
摘要
En 中文
Generating 3-D shapes with text inputs has long been a peculiar challenge in computer vision, which requires methodological know-how as well as a sense of art. Recently, text-to-image generation has driven remarkable progress, raising tremendous interest in text-guided shape generation, which further paves the way for industrial design. Nevertheless, prior efforts on text-guided 3-D synthesis either lack geometric details, are limited by the simple text input, or need expensive optimization and additional postprocessing, which make them unfriendly for novices. In this research, we present TFCNet, a novel approach for text-free controllable point cloud generation. In the training phase, we first design an empirically robust cross-modal skeletal point generator (CM-SPG) to predict skeletal points of the specific shape conditioned on the single image input. Then, we develop a diffusion-based dense point generator, which takes skeletal points as geometric guidance to produce dense point clouds that are faithful to the input images. In the inference phase, we propose an efficient text-free nonparametric transfer regime, which does not require separate training and can directly generate point cloud shapes while being semantically faithful to the provided text input. As evidenced by our experiments on the ShapeNet(v2) and CO3D datasets, our proposed method outperforms existing state of-the-art methods both quantitatively and qualitatively.
Keyword:
3-D point cloud
text-free controllable point cloud generation
text-guided 3-D generative modeling
期刊
IF:
5.9
论文数:
2.0W
被引数:
5.8W
机构
引用论文
Different Forms of Vigilance in Response to the Presence of Predators and Conspecifics in a Group‐Living Mammal, the European Rabbit
Ethology
IF0
Sensorless Control of Z Source Inverter fed BLDC Motor Drive by FOC - DTC Hybrid Control Strategy Using Fuzzy Logic Controller采用模糊逻辑控制器的foc-dtc混合控制策略的Z源逆变器馈电BLDC电机驱动的无传感器控制
Label-Free Biosensor Detection of Endocrine Disrupting Compounds Using Engineered Estrogen Receptors
Biosensors
IF0
Lösliche
trans
‐Di‐1‐alkinyl‐ und Poly‐
trans
‐ethinyl(tetraalkylphthalocyaninato)metall‐IVB‐DerivateLösliche
trans
-二-1-炔基-与聚-
trans
-乙炔基 (四烷基酞菁) 金属-ⅳ-衍生物

