.png){kind=icon}
返回
Semantic-Electromagnetic Inversion With Pretrained Multimodal Generative Model
.png){kind=icon}
OA
AI
DOI：10.1002/advs.202406793.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Across diverse domains of science and technology, electromagnetic (EM) inversion problems benefit from the ability to account for multimodal prior information to regularize their inherent ill-posedness. Indeed, besides priors that are formulated mathematically or learned from quantitative data, valuable prior information may be available in the form of text or images. Besides handling semantic multimodality, it is furthermore important to minimize the cost of adapting to a new physical measurement operator and to limit the requirements for costly labeled data. Here, these challenges are tackled with a frugal and multimodal semantic-EM inversion technique. The key ingredient is a multimodal generator of reconstruction results that can be pretrained, being agnostic to the physical measurement operator. The generator is fed by a multimodal foundation model encoding the multimodal semantic prior and a physical adapter encoding the measured data. For a new physical setting, only the lightweight physical adapter is retrained. The authors' architecture also enables a flexible iterative step-by-step solution to the inverse problem where each step can be semantically controlled. The feasibility and benefits of this methodology are demonstrated for three EM inverse problems: a canonical two-dimensional inverse-scattering problem in numerics, as well as three-dimensional and four-dimensional compressive microwave meta-imaging experiments. This work presents a semantic-EM inversion method capable of incorporating multimodal semantic priors in a flexible and frugal manner. It shows great advantages in handling semantic multimodality through a semantic-guided step-by-step manner and minimizing the cost of adapting to a new physical measurement operator and to limit the requirements for costly labeled training data. image
Keyword:
inverse scattering
microwave imaging
pretrained large-capacity foundation models
semantic-electromagnetic inverse problem
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
14.1
论文数:
1.8W
被引数:
11.5W
机构
引用论文
分享收藏Plug-and-Play Methods for Integrating Physical and Learned Models in Computational Imaging: Theory, algorithms, and applications在计算成像中集成物理和学习模型的即插即用方法: 理论，算法和应用
OAAI
OAAI分享收藏Large Metasurface Aperture for Millimeter Wave Computational Imaging at the Human-Scale.png)
SCIENTIFIC REPORTSOAAI
SCIENTIFIC REPORTSIF3.9
OAAI分享收藏
查看更多内容