arrow
Return

Fully nonlinear neuromorphic computing with linear wave scattering

delete2024-07-09
delete5
delete
OA
AI
C
Clara C. Wanjura
F
Florian Marquardt *
DOI:10.1038/s41567-024-02534-9delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The increasing size of neural networks for deep learning applications and their energy consumption create a need for alternative neuromorphic approaches, for example, using optics. Current proposals and implementations rely on physical nonlinearities or optoelectronic conversion to realize the required nonlinear activation function. However, there are considerable challenges with these approaches related to power levels, control, energy efficiency and delays. Here we present a scheme for a neuromorphic system that relies on linear wave scattering and yet achieves nonlinear processing with high expressivity. The key idea is to encode the input in physical parameters that affect the scattering processes. Moreover, we show that gradients needed for training can be directly measured in scattering experiments. We propose an implementation using integrated photonics based on racetrack resonators, which achieves high connectivity with a minimal number of waveguide crossings. Our work introduces an easily implementable approach to neuromorphic computing that can be widely applied in existing state-of-the-art scalable platforms, such as optics, microwave and electrical circuits. As the energy consumption of neural networks continues to grow, different approaches to deep learning are needed. A neuromorphic method offering nonlinear computation based on linear wave scattering can be implemented using integrated photonics.
Keywords:
ARTIFICIAL-INTELLIGENCE
NEURAL-NETWORKS
LOW-CROSSTALK
BACKPROPAGATION
PHOTONICS

Journal

Nature Physics cover
Nature Physics
IF:
18.4
Papers:
6.7K
Citations:
5.7W

Organization

M
Max Planck Society
Scholars:
8.2W
Papers: 7.7W
Citations: 3.3W
Cited Papers

Cited Papers

High probability of disrupting a disulphide bridge mediated by an endogenous excited tryptophan residue
err2009-04-13
err0
errOAAI
errMaria Teresa Neves‐Petersen; Zygmunt Gryczynski; Joseph Lakowicz; Peter Fojan; Shona Pedersen; Evamaria Petersen; Steffen Bjørn Petersen
errShare
errSave
errShare
errSave
Different copper oxide nanostructures: Synthesis, characterization, and application for C‐N cross‐coupling catalysis
err2011-09-01
err0
PREAI
errKeming Pan; Hai Ming; Hang Yu; Yang Liu; Zhenhui Kang; Hong Zhang; Shuit‐Tong Lee
errShare
errSave
An ARC light on lipid metabolism
err2006-09-01
err0
errOAAI
errRobert B. Rawson
errShare
errSave
Photonics for artificial intelligence and neuromorphic computing
err2021-01-29
err995
errOAAI
errShastri, Bhavin J.; Tait, Alexander N.; de Lima, T. Ferreira; Pernice, Wolfram H. P.; Bhaskaran, Harish; Wright, C. D.; Prucnal, Paul R.
errShare
errSave
Systematic literature review: Quantum machine learning and its applications
err2024-02-01
err27
errOAAI
errPeral-Garcia, David; Cruz-Benito, Juan; Garcia-Penalvo, Francisco Jose
errShare
errSave
Training of photonic neural networks through in situ backpropagation and gradient measurement
errOPTICA
IF8.5
err2018-07-19
err390
errOAAI
errHughes, Tyler W.; Minkov, Momchil; Shi, Yu; Fan, Shanhui
errShare
errSave
errShare
errSave
researcher View more