arrow
Return

A Spatio-Temporal Multi-Scale Binary Descriptor

delete2020-01-01
delete2
delete
OA
AI
A
Alessio Xompero *
O
Oswald Lanz
A
Andrea Cavallaro
DOI:10.1109/TIP.2020.2965277delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Binary descriptors are widely used for multi-view matching and robotic navigation. However, their matching performance decreases considerably under severe scale and viewpoint changes in non-planar scenes. To overcome this problem, we propose to encode the varying appearance of selected 3D scene points tracked by a moving camera with compact spatio-temporal descriptors. To this end, we first track interest points and capture their temporal variations at multiple scales. Then, we validate feature tracks through 3D reconstruction and compress the temporal sequence of descriptors by encoding the most frequent and stable binary values. Finally, we determine multi-scale correspondences across views with a matching strategy that handles severe scale differences. The proposed spatio-temporal multi-scale approach is generic and can be used with a variety of binary descriptors. We show the effectiveness of the joint multi-scale extraction and temporal reduction through comparisons of different temporal reduction strategies and the application to several binary descriptors.
Keywords:
Binary descriptor
spatio-temporal feature
multi-scale
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Image Processing cover
IEEE Transactions on Image Processing
IF:
13.7
Papers:
1.0W
Citations:
8.4W

Organization

Q
Queen Mary University London
Scholars:
2.0W
Papers: 1.5W
Citations: 327
U
university of london
Scholars:
21.5W
Papers: 19.7W
Citations: 305