返回
Multimodal In-Sensor Computing System Using Integrated Silicon Photonic Convolutional Processor
DOI:10.1002/advs.202408597.png)
摘要
En 中文
Photonic integrated circuits offer miniaturized solutions for multimodal spectroscopic sensory systems by leveraging the simultaneous interaction of light with temperature, chemicals, and biomolecules, among others. The multimodal spectroscopic sensory data is complex and has huge data volume with high redundancy, thus requiring high communication bandwidth associated with high communication power consumption to transfer the sensory data. To circumvent this high communication cost, the photonic sensor and processor are brought into intimacy and propose a photonic multimodal in-sensor computing system using an integrated silicon photonic convolutional processor. A microring resonator crossbar array is used as the photonic processor to implement convolutional operation with 5-bit accuracy, validated through image edge detection tasks. Further integrating the processor with a photonic spectroscopic sensor, the in situ processing of multimodal spectroscopic sensory data is demonstrated, achieving the classification of protein species of different types and concentrations at various temperatures. A classification accuracy of 97.58% across 45 different classes is achieved. The multimodal in-sensor computing system demonstrates the feasibility of integrating photonic processors and photonic sensors to enhance the data processing capability of photonic devices at the edge.
Keyword:
in-sensor computing
multimodal sensor
photonic convolutional process
silicon photonics
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
14.1
论文数:
1.8W
被引数:
11.5W
机构
引用论文
Tailoring Light-Matter Interactions in Overcoupled Resonator for Biomolecule Recognition and Detection在过耦合谐振器中定制光-物质相互作用以进行生物分子识别和检测
NANO-MICRO LETTERS
IF36.3
In-memory photonic dot-product engine with electrically programmable weight banks
NATURE COMMUNICATIONS
IF15.7
Recent Progress in Silicon-Based Photonic Integrated Circuits and Emerging Applications硅基光子集成电路的最新进展及新兴应用
Mid-Infrared Silicon-on-Lithium-Niobate Electro-Optic Modulators Toward Integrated Spectroscopic Sensing Systems面向集成光谱传感系统的中红外铌酸锂硅电光调制器
Human emotion recognition with a microcomb-enabled integrated optical neural network具有微梳功能的集成光学神经网络的人类情感识别
NANOPHOTONICS
IF6.6
Early hominid hunting, butchering, and carcass-processing behaviors: Approaches to the fossil record

