arrow
Return

High-clockrate free-space optical in-memory computing

delete2026-02-13
delete0
delete
OA
AI
Y
Yuanhao Liang
J
James Wang
K
Kaiwen Xue
X
Xinyi Ren
R
Ran Yin
S
Shaoyuan Ou
L
Lian Zhou
Y
Yuan Li
T
Tobias Heuser
N
Niels Heermeier
I
Ian Christen
J
James A. Lott
S
Stephan Reitzenstein
M
Mengjie Yu
Z
Zaijun Chen *
DOI:10.1038/s41377-026-02206-8delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The ability to process and act on data in real time is increasingly critical for applications ranging from autonomous vehicles, three-dimensional environmental sensing, and remote robotics. However, the deployment of deep neural networks (DNNs) in edge devices is hindered by the lack of energy-efficient scalable computing hardware. Here, we introduce a fanout spatial time-of-flight optical neural network (FAST-ONN) that calculates billions of convolutions per second with ultralow latency and power consumption. This is enabled by the combination of high-speed dense arrays of vertical-cavity surface-emitting lasers (VCSELs) for input modulation with spatial light modulators of high pixel counts for in-memory weighting. In a three-dimensional optical system, parallel differential readout allows signed weight values for accurate inference in a single shot. The performance is benchmarked with feature extraction in You-Only-Look-Once (YOLO) for convolution at 100 million frames per second (MFPS), and in-system backward propagation training with photonic reprogrammability. The VCSEL transmitters are implementable in any free-space optical computing systems to improve the clockrate to over gigahertz, where the high scalability in device counts and channel parallelism enables a new avenue to scale up free space computing hardware.
Keywords:
NEURAL-NETWORK
INFERENCE

Journal

L
Light-Science & Applications
IF:
23.4
Papers:
97
Citations:
0

Organization

U
university of southern california
Scholars:
4.7W
Papers: 3.8W
Citations: 51
U
university of california berkeley
Scholars:
1.4K
Papers: 811
Citations: 0
University of California System cover
University of California System
Scholars:
37.7W
Papers: 33.8W
Citations: 6.6K
researcher View more organizations
Cited Papers

Cited Papers

Advancing optical spiking neural networks with exciton-polaritons
err2025-10-24
err0
errOAAI
errKrzysztof Tyszka; Andrzej Opala; Barbara Piętka
errShare
errSave
Metasurface-enabled on-chip multiplexed diffractive neural networks in the visible
err2022-05-27
err0
errOAAI
errXuhao Luo; Yueqiang Hu; Xiangnian Ou; Xin Li; Jiajie Lai; Na Liu; Xinbin Cheng; Anlian Pan; Huigao Duan
errShare
errSave
Energy-Efficient Neural Network Inference with Microcavity Exciton Polaritons
err2021-08-25
err18
errOAAI
errMatuszewski, M.; Opala, A.; Mirek, R.; Furman, M.; Krol, M.; Tyszka, K.; Liew, T. C. H.; Ballarini, D.; Sanvitto, D.; Szczytko, J.; Pietka, B.
errShare
errSave
Hexagonal transverse-coupled-cavity VCSEL redefining the high-speed lasers
err2020-10-15
err48
errOAAI
errHeidari, Elham; Dalir, Hamed; Ahmed, Moustafa; Sorger, Volker J.; Chen, Ray T.
errShare
errSave
Deep Learning for Image and Point Cloud Fusion in Autonomous Driving: A Review
err2022-02-01
err256
errOAAI
errCui, Yaodong; Chen, Ren; Chu, Wenbo; Chen, Long; Tian, Daxin; Li, Ying; Cao, Dongpu
errShare
errSave
U-Net: Convolutional Networks for Biomedical Image Segmentation
err2015-11-18
err0
PREAI
errOlaf Ronneberger; Philipp Fischer; Thomas Brox
errShare
errSave
TPU v4: An Optically Reconfigurable Supercomputer for Machine Learning with Hardware Support for Embeddings
err2023-06-17
err0
errOAAI
errNorm Jouppi; George Kurian; Sheng Li; Peter Ma; Rahul Nagarajan; Lifeng Nai; Nishant Patil; Suvinay Subramanian; Andy Swing; Brian Towles; Clifford Young; Xiang Zhou; Zongwei Zhou; David A Patterson
errShare
errSave
Spectrally encoded single-pixel machine vision using diffractive networks
err2021-03-26
err138
errOAAI
errLi, Jingxi; Mengu, Deniz; Yardimci, Nezih T.; Luo, Yi; Li, Xurong; Veli, Muhammed; Rivenson, Yair; Jarrahi, Mona; Ozcan, Aydogan
errShare
errSave
researcher View more