arrow
Return

SceneTracker: Long-Term Scene Flow Estimation Network

delete2025-09-01
delete0
delete
OA
AI
王博 cover
王博 (Bo Wang)
李建 cover
李建 (Jian Li)
于
于洋 (Yang Yu)
L
Li Liu
Z
Zhenping Sun
D
Dewen Hu
DOI:10.1109/TPAMI.2025.3572489delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Considering that scene flow estimation has the capability of the spatial domain to focus but lacks the coherence of the temporal domain, this study proposes long-term scene flow estimation (LSFE), a comprehensive task that can simultaneously capture the fine-grained and long-term 3D motion in an online manner. We introduce SceneTracker, the first LSFE network that adopts an iterative approach to approximate the optimal 3D trajectory. The network dynamically and simultaneously indexes and constructs appearance correlation and depth residual features. Transformers are then employed to explore and utilize long-range connections within and between trajectories. With detailed experiments, SceneTracker shows superior capabilities in addressing 3D spatial occlusion and depth noise interference, highly tailored to the needs of the LSFE task. We build a real-world evaluation dataset, LSFDriving, for the LSFE field and use it in experiments to further demonstrate the advantage of SceneTracker in generalization abilities.
Keywords:
Long-term scene flow estimation
scene flow estimation
transformer

Journal

IEEE Transactions on Pattern Analysis and Machine Intelligence cover
IEEE Transactions on Pattern Analysis and Machine Intelligence
IF:
18.6
Papers:
1.1K
Citations:
9.8W

Organization

N
National University of Defense Technology
Scholars:
3.3K
Papers: 1.0K
Citations: 8.2K
Cited Papers

Cited Papers

SplatFlow: Learning Multi-frame Optical Flow via Splatting
err2024-02-29
err2
PREAI
errWang, Bo; Zhang, Yifan; Li, Jian; Yu, Yang; Sun, Zhenping; Liu, Li; Hu, Dewen
errShare
errSave
CoTracker: It Is Better to Track Together
err2024-10-31
err0
PREAI
errNikita Karaev; Ignacio Rocco; Benjamin Graham; Natalia Neverova; Andrea Vedaldi; Christian Rupprecht
errShare
errSave
4D Gaussian Splatting for Real-Time Dynamic Scene Rendering
err2024-06-16
err0
PREAI
errGuanjun Wu; Taoran Yi; Jiemin Fang; Lingxi Xie; Xiaopeng Zhang; Wei Wei; Wenyu Liu; Qi Tian; Xinggang Wang
errShare
errSave
errShare
errSave
FlowNet: Learning Optical Flow with Convolutional Networks
err2015-12-01
err0
errOAAI
errAlexey Dosovitskiy; Philipp Fischer; Eddy Ilg; Philip Hausser; Caner Hazirbas; Vladimir Golkov; Patrick van der Smagt; Daniel Cremers; Thomas Brox
errShare
errSave
Scalability in Perception for Autonomous Driving: Waymo Open Dataset
err2020-06-01
err0
errOAAI
errPei Sun; Henrik Kretzschmar; Xerxes Dotiwalla; Aurelien Chouard; Vijaysai Patnaik; Paul Tsui; James Guo; Yin Zhou; Yuning Chai; Benjamin Caine; Vijay Vasudevan; Wei Han; Jiquan Ngiam; Hang Zhao; Aleksei Timofeev; Scott Ettinger; Maxim Krivokon; Amy Gao; Aditya Joshi; Yu Zhang; Jonathon Shlens; Zhifeng Chen; Dragomir Anguelov
errShare
errSave
researcher View more