.png){kind=icon}
返回
Learning Semantic-Aware Local Features for Long Term Visual Localization
.png){kind=icon}
PRE
AI
DOI：10.1109/TIP.2022.3187565.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Extracting robust and discriminative local features from images plays a vital role for long term visual localization, whose challenges are mainly caused by the severe appearance differences between matching images due to the day-night illuminations, seasonal changes, and human activities. Existing solutions resort to jointly learning both keypoints and their descriptors in an end-to-end manner, leveraged on large number of annotations of point correspondence which are harvested from the structure from motion and depth estimation algorithms. While these methods show improved performance over non-deep methods or those two-stage deep methods, i.e., detection and then description, they are still struggled to conquer the problems encountered in long term visual localization. Since the intrinsic semantics are invariant to the local appearance changes, this paper proposes to learn semantic-aware local features in order to improve robustness of local feature matching for long term localization. Based on a state of the art CNN architecture for local feature learning, i.e., ASLFeat, this paper leverages on the semantic information from an off-the-shelf semantic segmentation network to learn semantic-aware feature maps. The learned correspondence-aware feature descriptors and semantic features are then merged to form the final feature descriptors, for which the improved feature matching ability has been observed in experiments. In addition, the learned semantics embedded in the features can be further used to filter out noisy keypoints, leading to additional accuracy improvement and faster matching speed. Experiments on two popular long term visual localization benchmarks (Aachen Day and Night v1.1, Robotcar Seasons) and one challenging indoor benchmark (InLoc) demonstrate encouraging improvements of the localization accuracy over its counterpart and other competitive methods.
Keyword:
Semantics
Location awareness
Visualization
Three-dimensional displays
Feature extraction
Benchmark testing
Image segmentation
Local feature
visual localization
knowledge distillation
image matching
期刊
IF:
13.7
论文数:
1.0W
被引数:
8.4W
机构
引用论文
Different Forms of Vigilance in Response to the Presence of Predators and Conspecifics in a Group‐Living Mammal, the European Rabbit.png)
Ethology
EthologyIF0
PREAI
分享收藏分享收藏分享收藏AutoMorph: Automated Retinal Vascular Morphology Quantification Via a Deep Learning PipelineAutoMorph: 通过深度学习管道自动量化视网膜血管形态
OAAI
OAAI分享收藏分享收藏
查看更多内容