arrow
Return

Detecting Every Object From Events

delete2025-08-01
delete0
delete
OA
AI
H
Haitian Zhang
C
Chang Xu
X
Xinya Wang
B
Bingde Liu
G
Guang Hua
L
Lei Yu
W
Wen Yang
DOI:10.1109/TPAMI.2025.3565102delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Object detection is critical in autonomous driving, and it is more practical yet challenging to localize objects of unknown categories: an endeavour known as Class-Agnostic Object Detection (CAOD). Existing studies on CAOD predominantly rely on RGB cameras, but these frame-based sensors usually have high latency and limited dynamic range, leading to safety risks under extreme conditions like fast-moving objects, overexposure, and darkness. In this study, we turn to the event-based vision, featured by its sub-millisecond latency and high dynamic range, for robust CAOD. We propose Detecting Every Object in Events (DEOE), an approach aimed at achieving high-speed, class-agnostic object detection in event-based vision. Built upon the fast event-based backbone: recurrent vision transformer, we jointly consider the spatial and temporal consistencies to identify potential objects. The discovered potential objects are assimilated as soft positive samples to avoid being suppressed as backgrounds. Moreover, we introduce a disentangled objectness head to separate the foreground-background classification and novel object discovery tasks, enhancing the model's generalization in localizing novel objects while maintaining a strong ability to filter out the background. Extensive experiments confirm the superiority of our proposed DEOE in both open-set and closed-set settings, outperforming strong baseline methods.
Keywords:
Class-agnostic object detection
high-speed detection
event camera
autonomous driving

Journal

IEEE Transactions on Pattern Analysis and Machine Intelligence cover
IEEE Transactions on Pattern Analysis and Machine Intelligence
IF:
18.6
Papers:
1.1K
Citations:
9.8W

Organization

S
Singapore Institute of Technology
Scholars:
848
Papers: 772
Citations: 817
I
Institute of Science Tokyo
Scholars:
3.2W
Papers: 2.7W
Citations: 117
W
wuhan university
Scholars:
8.1W
Papers: 5.8W
Citations: 70
researcher View more organizations
Cited Papers

Cited Papers

Event-Based Vision: A Survey
err2022-01-01
err0
errOAAI
errGuillermo Gallego; Tobi Delbruck; Garrick Orchard; Chiara Bartolozzi; Brian Taba; Andrea Censi; Stefan Leutenegger; Andrew J. Davison; Jorg Conradt; Kostas Daniilidis; Davide Scaramuzza
errShare
errSave
errShare
errSave
Long Short-Term Memory
err1997-11-01
err0
PREAI
errSepp Hochreiter; Jürgen Schmidhuber
errShare
errSave
Low-latency automotive vision with event cameras
err2024-05-29
err0
errOAAI
errDaniel Gehrig; Davide Scaramuzza
errShare
errSave
errShare
errSave
Learning to Detect Every Thing in an Open World
err2022-11-06
err0
PREAI
errKuniaki Saito; Ping Hu; Trevor Darrell; Kate Saenko
errShare
errSave
researcher View more