arrow
Return

Vision without the Image

delete2016-04-06
delete10
delete
OA
AI
B
Bo Chen
P
Pietro Perona *
DOI:10.3390/s16040484delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Novel image sensors transduce the stream of photons directly into asynchronous electrical pulses, rather than forming an image. Classical approaches to vision start from a good quality image and therefore it is tempting to consider image reconstruction as a first step to image analysis. We propose that, instead, one should focus on the task at hand (e.g., detection, tracking or control) and design algorithms that compute the relevant variables (class, position, velocity) directly from the stream of photons. We discuss three examples of such computer vision algorithms and test them on simulated data from photon-counting sensors. Such algorithms work just-in-time, i.e., they complete classification, search and tracking with high accuracy as soon as the information is sufficient, which is typically before there are enough photons to form a high-quality image. We argue that this is particularly useful when the photons are few or expensive, e.g., in astronomy, biological imaging, surveillance and night vision.
Keywords:
photon-counting sensors
visual recognition
low-light computer vision
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Sensors cover
Sensors
IF:
3.5
Papers:
7.2W
Citations:
20.9W

Organization

C
California Institute of Technology
Scholars:
2.9W
Papers: 2.5W
Citations: 4.9W
Cited Papers

Cited Papers

Pathogenic Anti-DNA Antibodies in SLE: Idiotypic Families and Genetic Origins
err2009-07-10
err0
PREAI
errElahna Paul; Audrey Manheimer-Lory; Avi Livneh; Andrew Solomon; Cynthia Aranow; Cybele Ghossein; Rachel Shefner; Daniel Offen; Michael Pillinger; Betty Diamond
errShare
errSave
INTERGALACTIC MEDIUM EMISSION OBSERVATIONS WITH THE COSMIC WEB IMAGER. I. THE CIRCUM-QSO MEDIUM OF QSO 1549+19, AND EVIDENCE FOR A FILAMENTARY GAS INFLOW
err2014-04-24
err114
errOAAI
errMartin, D. Christopher; Chang, Daphne; Matuszewski, Matt; Morrissey, Patrick; Rahman, Shahin; Moore, Anna; Steidel, Charles C.
errShare
errSave
Imaging with a small number of photons
err2015-01-05
err364
errOAAI
errMorris, Peter A.; Aspden, Reuben S.; Bell, Jessica E. C.; Boyd, Robert W.; Padgett, Miles J.
errShare
errSave
Functional Activity of Mitochondrial Nitric Oxide Synthase
err2005-01-01
err0
PREAI
errLaura B. Valdez; Tamara Zaobornyj; Alberto Boveris
errShare
errSave
Experimental realization of sub-shot-noise quantum imaging
err2010-02-28
err557
PREAI
errBrida, G.; Genovese, M.; Berchera, I. Ruo
errShare
errSave
Gradient-based learning applied to document recognition
err1998-01-01
err3.8W
PREAI
errLecun, Y; Bottou, L; Bengio, Y; Haffner, P
errShare
errSave
User Experience with Smartphone Repair Activities and The Impact of Modular Product Design
err
IF0
err2021-01-01
err0
errOAAI
errClara Amend; Ferdinand Revellio; Isabell Tenner; Stefan Schaltegger
errShare
errSave
researcher View more