arrow
返回

Multimodal In-Sensor Computing System Using Integrated Silicon Photonic Convolutional Processor

delete2024-10-28
delete0
delete
OA
AI
Z
Zian Xiao
Z
Zhihao Ren
Z
Zhuge, Yangyang
B
Bowei Dong
J
Jingkai Zhou
S
Siyu Xu
C
Cheng Xu
C
Chengkuo Lee *
DOI:10.1002/advs.202408597delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Photonic integrated circuits offer miniaturized solutions for multimodal spectroscopic sensory systems by leveraging the simultaneous interaction of light with temperature, chemicals, and biomolecules, among others. The multimodal spectroscopic sensory data is complex and has huge data volume with high redundancy, thus requiring high communication bandwidth associated with high communication power consumption to transfer the sensory data. To circumvent this high communication cost, the photonic sensor and processor are brought into intimacy and propose a photonic multimodal in-sensor computing system using an integrated silicon photonic convolutional processor. A microring resonator crossbar array is used as the photonic processor to implement convolutional operation with 5-bit accuracy, validated through image edge detection tasks. Further integrating the processor with a photonic spectroscopic sensor, the in situ processing of multimodal spectroscopic sensory data is demonstrated, achieving the classification of protein species of different types and concentrations at various temperatures. A classification accuracy of 97.58% across 45 different classes is achieved. The multimodal in-sensor computing system demonstrates the feasibility of integrating photonic processors and photonic sensors to enhance the data processing capability of photonic devices at the edge.
Keyword:
in-sensor computing
multimodal sensor
photonic convolutional process
silicon photonics
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Advanced Science 封面图
Advanced Science
IF:
14.1
论文数:
1.8W
被引数:
11.5W

机构

N
National University of Singapore
学者数:
7.6W
论文数: 6.5W
被引数: 11.4W
引用论文

引用论文

In-memory photonic dot-product engine with electrically programmable weight banks
err2023-05-20
err59
errOAAI
errZhou, Wen; Dong, Bowei; Farmakidis, Nikolaos; Li, Xuan; Youngblood, Nathan; Huang, Kairan; He, Yuhan; David Wright, C.; Pernice, Wolfram H. P.; Bhaskaran, Harish
err分享
err收藏
Human emotion recognition with a microcomb-enabled integrated optical neural network具有微梳功能的集成光学神经网络的人类情感识别
err2023-10-02
err22
errOAAI
errCheng, Junwei; Xie, Yanzhao; Liu, Yu; Song, Junjie; Liu, Xinyu; He, Zhenming; Zhang, Wenkai; Han, Xinjie; Zhou, Hailong; Zhou, Ke; Zhou, Heng; Dong, Jianji; Zhang, Xinliang
err分享
err收藏
Photonics for artificial intelligence and neuromorphic computing用于人工智能和神经形态计算的光子学
err2021-01-29
err995
errOAAI
errShastri, Bhavin J.; Tait, Alexander N.; de Lima, T. Ferreira; Pernice, Wolfram H. P.; Bhaskaran, Harish; Wright, C. D.; Prucnal, Paul R.
err分享
err收藏
学者 查看更多内容