arrow
Return

Time-Lapse Image Classification Using a Diffractive Neural Network

delete2023-02-21
delete16
delete
OA
AI
M
Md Sadman Sakib Rahman
A
Aydogan Özcan *
DOI:10.1002/aisy.202200387delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Diffractive deep neural networks (D(2)NNs), comprised of spatially engineered passive surfaces, collectively process optical input information at the speed of light propagation through a thin diffractive volume, without any external computing power. Diffractive networks were demonstrated to achieve all-optical object classification and perform universal linear transformations. Herein, a time-lapse image classification scheme using a diffractive network is demonstrated for the first time, significantly advancing its classification accuracy and generalization performance on complex input objects by using the lateral movements of the input objects and/or the diffractive network, relative to each other. In a different context, such relative movements of the objects and/or the camera are routinely being used for image super-resolution applications; inspired by their success, a time-lapse diffractive network is designed to benefit from the complementary information content created by controlled or random lateral shifts. The design space and performance limits of time-lapse diffractive networks are numerically explored, revealing a blind testing accuracy of 62.03% on the optical classification of objects from the CIFAR-10 dataset. This constitutes the highest inference accuracy achieved so far using a single diffractive network on the CIFAR-10 dataset. Time-lapse diffractive networks will be broadly useful for the spatiotemporal analysis of input signals using all-optical processors.
Keywords:
diffractive deep neural networks ((DNN)-N-2)
diffractive computing
diffractive deep neural networks
diffractive networks
optical computing

Journal

Advanced Intelligent Systems cover
Advanced Intelligent Systems
IF:
6.1
Papers:
2.0K
Citations:
8.4K

Organization

University of California System cover
University of California System
Scholars:
37.7W
Papers: 33.8W
Citations: 6.6K
Cited Papers

Cited Papers

err
IF0
err
err0
PREAI
err
errShare
errSave
errShare
errSave
Development of a Simulation Framework for Analyzing Security of Supply in Integrated Gas and Electric Power Systems
err2017-01-05
err0
errOAAI
errKwabena Pambour; Burcin Cakir Erdener; Ricardo Bolado-Lavin; Gerard Dijkema
errShare
errSave
To image, or not to image: class-specific diffractive cameras with all-optical erasure of undesired objects
errELIGHT
IF32.1
err2022-08-15
err61
errOAAI
errBai, Bijie; Luo, Yi; Gan, Tianyi; Hu, Jingtian; Li, Yuhang; Zhao, Yifan; Mengu, Deniz; Jarrahi, Mona; Ozcan, Aydogan
errShare
errSave
A pan‐inflammatory microRNA‐cluster is associated with orbital non‐Hodgkin lymphoma and idiopathic orbital inflammation
err2019-11-25
err0
errOAAI
errKamil G. Laban; Rachel Kalmann; Cornelis P. J. Bekker; Sanne Hiddingh; Rob L. P. van der Veen; Christine A. E. Eenhorst; Stijn W. Genders; Maarten P. Mourits; Fleurieke H. Verhagen; Emmerik F. A. Leijten; Saskia Haitjema; Mark C. H. de Groot; Timothy R. D. J. Radstake; Joke H. de Boer; Jonas J. W. Kuiper
errShare
errSave
Computational imaging without a computer: seeing through random diffusers at the speed of light
errELIGHT
IF32.1
err2022-01-26
err136
errOAAI
errLuo, Yi; Zhao, Yifan; Li, Jingxi; Cetintas, Ege; Rivenson, Yair; Jarrahi, Mona; Ozcan, Aydogan
errShare
errSave
Broad-spectrum diffractive network via ensemble learning
err2022-01-28
err17
errOAAI
errShi, Jiashuo; Chen, Yingshi; Zhang, Xinyu
errShare
errSave
Super-resolution image display using diffractive decoders
err2022-12-02
err26
errOAAI
errIsil, Cagatay; Mengu, Deniz; Zhao, Yifan; Tabassum, Anika; Li, Jingxi; Luo, Yi; Jarrahi, Mona; Ozcan, Aydogan
errShare
errSave
researcher View more