arrow
返回

Meta-Optics Based Parallel Convolutional Processing for Neural Network Accelerator

delete2024-06-22
delete2
delete
OA
AI
M
Mingcheng Luo
T
Tengji Xu
S
Shuqi Xiao
H
Hon Ki Tsang
C
Chester Shu
C
Chaoran Huang *
DOI:10.1002/lpor.202300984delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Convolutional neural networks (CNNs) have shown great performance in computer vision tasks, from image classification to pattern recognition. However, CNNs '${\rm CNNs}<^>{\prime }$ superior performance arises at the expense of high computational costs, which restricts their employment in real-time decision-making applications. Computationally intensive convolutions can be offloaded to optical metasurfaces, enabling sub-picosecond latency and nearly zero energy consumption, but the currently reported approaches require additional bulk optics and can only process polarized light, which limits their practical usages in integrated lightweight systems. To solve these challenges, a novel design of the metasurface-based optical convolutional accelerator is experimentally demonstrated, offering an ultra-compact volume of 0.016 mm3${\rm mm}<^>{3}$, a low cross-talk of -20 dB, polarization insensitivity, and is capable of implementing multiple convolution operations and extracting simultaneously various features from light-encoded images. The ultra-compact metasurface-based optical accelerator can be compactly integrated with a digital imaging system to constitute an optical-electronic hybrid CNN, which experimentally achieves a consistent accuracy of 96 % in arbitrarily polarized MNIST digits classification. The proposed ultra-compact metasurface-based optical convolutional accelerator paves the way for power-efficient edge-computing platforms for a range of machine vision applications. This work experimentally demonstrates a novel design of the metasurface-based optical convolutional accelerator offering an ultra-compact volume of 0.016 mm3${\rm mm}<^>{3}$, low cross-talk of -20 dB, polarization insensitivity, and is capable of implementing multiple convolution operations and extracting simultaneously various features from light-encoded images. The metasurface-based optical convolutional accelerator paves the way for power-efficient edge-computing platforms for machine vision applications. image
Keyword:
convolution
machine vision
mie resonance
optical metasurfaces
photonic neural network
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

L
Laser and Photonics Reviews
IF:
10
论文数:
3.7K
被引数:
2.1W

机构

C
chinese university of hongkong
学者数:
2
论文数: 1
被引数: 0
引用论文

引用论文

Mechanisms of 2π phase control in dielectric metasurface and transmission enhancement effect
err2019-07-30
err37
errOAAI
errLi, Jing; Wu, Tiesheng; Xu, Wenbin; Liu, Yumin; Liu, Chang; Wang, Yu; Yu, Zhongyuan; Zhu, Danfeng; Yu, Li; Ye, Han
err分享
err收藏
Broadband and Wide Field-of-view Plasmonic Metasurface-enabled Waveplates
err2014-12-19
err118
errOAAI
errJiang, Zhi Hao; Lin, Lan; Ma, Ding; Yun, Seokho; Werner, Douglas H.; Liu, Zhiwen; Mayer, Theresa S.
err分享
err收藏
Efficient Focusing with Large Numerical Aperture Using a Hybrid Metalens
err2020-04-07
err72
PREAI
errKang, Ming; Ra'di, Younes; Farfan, Diego; Alu, Andrea
err分享
err收藏
Designing of marker-based augmented reality learning environment for kids using convolutional neural network architecture
err2018-12-01
err29
PREAI
errDash, Ajaya Kumar; Behera, Santosh Kumar; Dogra, Debi Prosad; Roy, Partha Pratim
err分享
err收藏
err分享
err收藏
err分享
err收藏
Broadband achromatic optical metasurface devices宽带消色差光学超表面器件
err2017-08-04
err962
errOAAI
errWang, Shuming; Wu, Pin Chieh; Su, Vin-Cent; Lai, Yi-Chieh; Chu, Cheng Hung; Chen, Jia-Wern; Lu, Shen-Hung; Chen, Ji; Xu, Beibei; Kuan, Chieh-Hsiung; Li, Tao; Zhu, Shining; Tsai, Din Ping
err分享
err收藏
err分享
err收藏
学者 查看更多内容