arrow
Return

PointDiffuse: A Dual-Conditional Diffusion Model for Enhanced Point Cloud Semantic Segmentation

delete2026-08-11
delete0
PRE
AI
Y
Yong He
H
Hongshan Yu
M
Mingtao Feng
Z
Zechuan Li
T
Tongjia Chen
A
Anwaar Ulhaq
S
Saeed Anwar
A
Ajmal Mian
DOI:10.1109/tase.2026.3722737delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Diffusion probabilistic models are traditionally used to generate colors at fixed pixel positions in 2D images. Building on this, we extend diffusion models to point cloud semantic segmentation, where point positions also remain fixed, and the diffusion model generates point labels instead of colors. To accelerate the denoising process in reverse diffusion, we introduce a noisy label embedding mechanism. This approach integrates semantic information into the noisy label, providing an initial semantic reference that improves the reverse diffusion efficiency. Additionally, we propose a point frequency transformer that enhances the adjustment of high-level context in point clouds. To reduce computational complexity, we introduce the position condition into MLP and propose denoising PointNet to process the high-resolution point cloud without sacrificing geometric details. Finally, we integrate the proposed noisy label embedding, point frequency transformer and denoising PointNet in our proposed dual conditional diffusion model-based network (PointDiffuse) to perform large-scale point cloud semantic segmentation. Extensive experiments on five benchmarks demonstrate the superiority of PointDiffuse, achieving the state-of-the-art mIoU of 74.2% on S3DIS Area 5, 81.2% on S3DIS 6-fold and 64.8% on SWAN dataset. Note to Practitioners—Point cloud semantic segmentation is vital for automation in robotics, autonomous driving, and 3D inspection. Real-world point clouds are often noisy and geometrically distorted, challenging conventional segmentation methods. The proposed PointDiffuse framework tackles this by using a diffusion model to directly generate point labels, turning the segmentation task into a robust denoising process. Its Noisy Label Embedding and Point Frequency Transformer are specifically designed to handle the uncertainty and noise inherent in sensor data, improving reliability in practical applications. Current work focuses on single-dataset training; future efforts will explore multi-dataset joint training to enhance generalization across diverse environments and sensor types.
Keywords:
3D point clouds
point frequency transformer
diffusion model

Journal

IEEE Transactions on Automation Science and Engineering cover
IEEE Transactions on Automation Science and Engineering
IF:
6.4
Papers:
5.1K
Citations:
1.6W

Organization

T
The University of Western Australia
Scholars:
153
Papers: 82
Citations: 0
C
Central Queensland University
Scholars:
81
Papers: 43
Citations: 0
H
Hunan University
Scholars:
2.0K
Papers: 605
Citations: 0
A
Anhui University
Scholars:
1.1K
Papers: 333
Citations: 0
X
xidian university
Scholars:
1.8K
Papers: 544
Citations: 0
researcher View more organizations
Cited Papers

Cited Papers

No cited papers available