arrow
Return

Event Camera Meets Mobile Embodied Perception: Abstraction, Algorithm, Acceleration, Application

delete2026-05-23
delete0
PRE
AI
H
Haoyang Wang
R
Ruishan Guo
P
Pengtao Ma
C
Ciyu Ruan
X
Xinyu Luo
W
Wenhua Ding
T
Tianyang Zhong
J
Jingao Xu
L
Liu, Yunhou
X
Xinlei Chen *
DOI:10.1145/3786332delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
With the evolution of mobile embodied intelligence, agents such as drones and autonomous robots are transitioning toward high agility. This shift imposes stringent demands on embodied perception, requiring high-accuracy and low-latency feedback loops for reliable interaction. Event-based vision has emerged as a transformative paradigm. Its microsecond-level temporal resolution and high dynamic range render it ideal for embodied perception tasks on high-agility mobile platforms. However, asynchronous nature, substantial noise, lack of persistent semantic information, and large data volume pose challenges for processing on resource-constrained mobile agents. This article surveys the literature from 2014-2025 and presents a comprehensive overview of event-based mobile embodied perception. We organize review around four key pillars: event abstraction methods, perception algorithm advancements, hardware and software acceleration strategies, and mobile applications. We discuss critical tasks including visual odometry, object tracking, optical flow, and 3D reconstruction, while highlighting challenges associated with sensor fusion and real-time deployment. Furthermore, we outline future research directions, such as improving event cameras with advanced optics and leveraging neuromorphic computing for efficient processing. To support ongoing research, we provide an open-source Online Sheet with recent developments. We hope this survey serves as a reference, facilitating adoption of event-based vision across diverse mobile embodied applications.
Keywords:
Embodied AI
mobile embodied perception
event camera
event-based vision

Journal

ACM Computing Surveys cover
ACM Computing Surveys
IF:
28
Papers:
2.5K
Citations:
3.5W

Organization

U
university of hong kong
Scholars:
3.6K
Papers: 1.7K
Citations: 0
T
tsinghua university
Scholars:
11.9W
Papers: 10.0W
Citations: 137
Cited Papers

Cited Papers

Secrets of Event-Based Optical Flow
err2022-11-03
err0
errOAAI
errShintaro Shiba; Yoshimitsu Aoki; Guillermo Gallego
errShare
errSave
H-SwarmLoc
err2023-01-24
err0
errOAAI
errHaoyang Wang; Xuecheng Chen; Yuhan Cheng; Chenye Wu; Fan Dang; Xinlei Chen
errShare
errSave
Event-Based Vision: A Survey
err2022-01-01
err0
errOAAI
errGuillermo Gallego; Tobi Delbruck; Garrick Orchard; Chiara Bartolozzi; Brian Taba; Andrea Censi; Stefan Leutenegger; Andrew J. Davison; Jorg Conradt; Kostas Daniilidis; Davide Scaramuzza
errShare
errSave
DDL: Empowering Delivery Drones With Large-Scale Urban Sensing Capability
err2024-04-01
err1
PREAI
errChen, Xuecheng; Wang, Haoyang; Cheng, Yuhan; Fu, Haohao; Liu, Yuxuan; Dang, Fan; Liu, Yunhao; Cui, Jinqiang; Chen, Xinlei
errShare
errSave
errShare
errSave
DEVO: Depth-Event Camera Visual Odometry in Challenging Conditions
err2022-05-23
err0
errOAAI
errYi-Fan Zuo; Jiaqi Yang; Jiaben Chen; Xia Wang; Yifu Wang; Laurent Kneip
errShare
errSave
researcher View more