arrow
Return

Sparse pixel image sensor

delete2022-04-05
delete4
delete
OA
AI
L
Lukas Mennel
D
Dmitry K. Polyushkin
D
Dohyun Kwak
T
Thomas Mueller *
DOI:10.1038/s41598-022-09594-ydelete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
As conventional frame-based cameras suffer from high energy consumption and latency, several new types of image sensors have been devised, with some of them exploiting the sparsity of natural images in some transform domain. Instead of sampling the full image, those devices capture only the coefficients of the most relevant spatial frequencies. The number of samples can be even sparser if a signal only needs to be classified rather than being fully reconstructed. Based on the corresponding mathematical framework, we developed an image sensor that can be trained to classify optically projected images by reading out the few most relevant pixels. The device is based on a two-dimensional array of metal-semiconductor-metal photodetectors with individually tunable photoresponsivity values. We demonstrate its use for the classification of handwritten digits with an accuracy comparable to that achieved by readout of the full image, but with lower delay and energy consumption.
Keywords:
VISION
PLACEMENT
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Scientific Reports cover
Scientific Reports
IF:
3.9
Papers:
28.0W
Citations:
83.5W

Organization

T
Technische Universitat Wien
Scholars:
1.3W
Papers: 1.1W
Citations: 21
Cited Papers

Cited Papers

k-Nearest Neighbour method in functional nonparametric regression
err2009-05-01
err0
PREAI
errFlorent Burba; Frédéric Ferraty; Philippe Vieu
errShare
errSave
Compressive Coded Aperture Spectral Imaging
err2014-01-01
err492
PREAI
errArce, Gonzalo R.; Brady, David J.; Carin, Lawrence; Arguello, Henry; Kittle, David S.
errShare
errSave
Sparsity enabled cluster reduced-order models for control
err2018-01-01
err19
errOAAI
errKaiser, Eurika; Morzynski, Marek; Daviller, Guillaume; Kutz, J. Nathan; Brunton, Bingni W.; Brunton, Steven L.
errShare
errSave
Artificial optic-neural synapse for colored and color-mixed pattern recognition
err2018-11-30
err555
errOAAI
errSeo, Seunghwan; Jo, Seo-Hyeon; Kim, Sungho; Shim, Jaewoo; Oh, Seyong; Kim, Jeong-Hoon; Heo, Keun; Choi, Jae-Woong; Choi, Changhwan; Oh, Saeroonter; Kuzum, Duygu; Wong, H. -S. Philip; Park, Jin-Hong
errShare
errSave
The Impact of Pre-existing Immunity on the Non-clinical Pharmacodynamics of AAV5-Based Gene Therapy
err2019-06-01
err0
errOAAI
errBrian R. Long; Krystal Sandza; Jennifer Holcomb; Lucy Crockett; Gregory M. Hayes; Jeremy Arens; Carlos Fonck; Laurie S. Tsuruda; Becky Schweighardt; Charles A. O’Neill; Stephen Zoog; Christian Vettermann
errShare
errSave
Optoelectronic resistive random access memory for neuromorphic vision sensors
err2019-07-15
err955
PREAI
errZhou, Feichi; Zhou, Zheng; Chen, Jiewei; Choy, Tsz Hin; Wang, Jingli; Zhang, Ning; Lin, Ziyuan; Yu, Shimeng; Kang, Jinfeng; Wong, H-S Philip; Chai, Yang
errShare
errSave
Single-pixel imaging via compressive sampling
err2008-03-01
err3.0K
PREAI
errDuarte, Marco F.; Davenport, Mark A.; Takhar, Dharmpal; Laska, Jason N.; Sun, Ting; Kelly, Kevin F.; Baraniuk, Richard G.
errShare
errSave
researcher View more