.png){kind=icon}
Return
Interpretable procedural material graph generation via diffusion models from reference images
.png){kind=icon}
PRE
AI
DOI：10.1007/s00371-025-04096-0.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Procedural materials, generated through algorithmic processes, offer advantages such as resolution independence, editability, and real-time rendering capabilities. Despite these merits, constructing procedural material graphs remains a labor-intensive task. Recent advancements in generative neural networks, particularly diffusion models, have shown promise in automating this process. However, existing methods often struggle with issues related to generation quality, generalization, and interpretability. In this work, we introduce a novel approach for the interpretable generation of procedural material graphs from reference images using diffusion model. Our approach predicts individual nodes in reverse order, leveraging the generative capabilities of diffusion models to achieve significant improvements in generation quality, generalization, and interpretability. Specifically, we employ a two-stage framework: an adapter-based diffusion model predicts procedural nodes, forming an auxiliary graph, which is then refined using a DiffMat-based node parameter optimization method. To validate the effectiveness of our approach, we construct a fine-grained procedural material graph dataset containing extensive data and information defined at the node level. Our code and datasets are available at: https://github.com/InterS23/IPMGG .
Keywords:
Procedural material
Diffusion models
Texture generation
Procedural models
Journal
IF:
2.9
Papers:
4.6K
Citations:
6.5K
Organization
View more organizations
Cited Papers
.png){kind=icon}
ShareSaveShareSaveShareSaveShareSave View more