arrow
Return

Photonic modes prediction via multi-modal diffusion model

delete2024-09-05
delete0
delete
OA
AI
J
Jinyang Sun
X
Xi Chen
W
Wang, Xiumei
D
Dandan Zhu *
X
Xingping Zhou *
DOI:10.1088/2632-2153/ad743fdelete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The concept of photonic modes is the cornerstone in optics and photonics, which can describe the propagation of the light. The Maxwell's equations play the role in calculating the mode field based on the structure information, while this process needs a great deal of computations, especially in the handle with a three-dimensional model. To overcome this obstacle, we introduce the multi-modal diffusion model to predict the photonic modes in one certain structure. The Contrastive Language-Image Pre-training (CLIP) model is used to build the connections between photonic structures and the corresponding modes. Then we exemplify Stable Diffusion (SD) model to realize the function of optical fields generation from structure information. Our work introduces multi-modal deep learning to construct complex mapping between structural information and optical field as high-dimensional vectors, and generates optical field images based on this mapping.
Keywords:
photonic modes
multi-modal diffusion model
contrastive language-image pre-training (CLIP)
stable diffusion (SD) model
optical field generation

Journal

M
Machine Learning-Science and Technology
IF:
4.6
Papers:
1.1K
Citations:
3.4K

Organization

E
east china normal university
Scholars:
3.1W
Papers: 2.1W
Citations: 25