arrow
Return

Temporal coding enables hyperacuity in event-based vision

delete2026-08-20
delete0
delete
OA
AI
E
Eldad Assa
A
Alexander Rivkind *
M
Michael Kreiserman
F
Fahad Shahbaz Khan
S
Salman Khan
E
Ehud Ahissar *
DOI:10.1038/s41467-026-76878-6delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Although the eye may appear static during fixation, it is in constant motion–transforming visual input into rich spatio-temporal streams of neuronal activity. These movements challenge the classical view that visual acuity derives from spatial sampling, suggesting that hyperacuity can emerge from precise temporal encoding. Here we show that artificial systems can exploit this principle using retina-like event-based (EB) sensing, a neuromorphic approach in which the sensor emits asynchronous spikes in response to luminance changes. Using an EB camera undergoing controlled “fixational” motion over tiny, pixelated images, we generated datasets in which recognition depends on sub-pixel information. We found that artificial neural networks trained on these spatio-temporal event streams relied crucially on the precise temporal information and outperformed conventional frame-based models. The learned representations also supported Vernier-style sub-pixel discrimination, demonstrating hyperacuity-like behavior in the artificial bio-mimetic system. These results show that active event-based sensing can use precise timing to recover spatial details that are unrecoverable from a static single frame. Together, these findings offer a new perspective on visual perception, open pathways for advancing neuromorphic engineering and energy-efficient AI vision systems, and provide a framework for testing hypotheses about biological vision. Unlike conventional frame-based vision, biomimetic event-based sensing preserves precise temporal information. The authors show that these timing signals can be exploited to recover spatial details from tiny images, enabling event-based vision to outperform frame-based approaches.
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Nature Communications cover
Nature Communications
IF:
15.7
Papers:
9.3W
Citations:
91.2W

Organization

Cited Papers

Cited Papers

Fixational eye movements enhance the precision of visual information transmitted by the primate retina
err
err0
PREAI
errWu,Eric G.; Brackbill,Nora; Rhoades,Colleen; Kling,Alexandra; Gogliettino,Alex R.; Shah,Nishal P.; Sher,Alexander; Litke,Alan M.; Simoncelli,Eero P.; Chichilnisky,E. J.
errShare
errSave
Event-Based Vision: A Survey
err2022-01-01
err0
errOAAI
errGuillermo Gallego; Tobi Delbruck; Garrick Orchard; Chiara Bartolozzi; Brian Taba; Andrea Censi; Stefan Leutenegger; Andrew J. Davison; Jorg Conradt; Kostas Daniilidis; Davide Scaramuzza
errShare
errSave
Miniature eye movements enhance fine spatial detail
err2007-06-01
err0
PREAI
errMichele Rucci; Ramon Iovin; Martina Poletti; Fabrizio Santini
errShare
errSave
Resolution Acuity is better than Vernier Acuity
err1997-03-01
err0
errOAAI
errTHOM CARNEY; STANLEY A. KLEIN
errShare
errSave
Neuromorphic Event-Based Generalized Time-Based Stereovision
err2018-07-02
err20
errOAAI
errIeng, Sio-Hoi; Carneiro, Joao; Osswald, Marc; Benosman, Ryad
errShare
errSave
errShare
errSave
Spiking Optical Flow for Event-Based Sensors Using IBM's TrueNorth Neurosynaptic System
err2018-08-01
err63
errOAAI
errHaessig, Germain; Cassidy, Andrew; Alvarez, Rodrigo; Benosman, Ryad; Orchard, Garrick
errShare
errSave
researcher View more