arrow
Return

Debiased Multiplex Tokenization Using Mamba-Based Pointers for Efficient and Versatile Map-Free Visual Relocalization

delete2026-03-26
delete0
delete
OA
AI
W
Wenshuai Wang
刘宏 cover
刘宏 (Hong Liu) *
S
Shengquan Li
P
Peifeng Jiang
D
Dandan Che
R
Runwei Ding *
DOI:10.3390/make8030083delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Visual localization plays a critical role for mobile robots to estimate their position and orientation in GPS-denied environments. However, its efficiency, robustness, and generalization are fundamentally undermined by severe viewpoint changes and dramatic appearance variations, which present persistent challenges for image-based feature representation and pose estimation under real-world conditions. Recently, map-free visual relocalization (MFVR) has emerged as a promising paradigm for lightweight deployment and privacy isolation on edge devices, while how to learn compact and invariant image tokens without relying on structural 3D maps still remains a core problem, particularly in highly dynamic or long-term scenarios. In this paper, we propose the Debiased Multiplex Tokenizer as a novel method (termed as DMT-Loc) for efficient and versatile MFVR to address these issues. Specifically, DMT-Loc is built upon a pretrained vision Mamba encoder and integrates three key modules for relative pose regression: First, Multiplex Interactive Tokenization yields robust image tokens with non-local affinities and cross-domain descriptions. Second, Debiased Anchor Registration facilitates anchor token matching through proximity graph retrieval and autoregressive pointer attribution. Third, Geometry-Informed Pose Regression empowers multi-layer perceptrons with a symmetric swap gating mechanism operating inside each decoupled regression head to support accurate and flexible pose prediction in both pair-wise and multi-view modes. Extensive evaluations across seven public datasets demonstrate that DMT-Loc substantially outperforms existing baselines and ablation variants in diverse indoor and outdoor environments.
Keywords:
visual localization
relative pose regression
Mamba codec
causal attention
pointer network

Journal

M
Machine Learning and Knowledge Extraction
IF:
6
Papers:
865
Citations:
1.8K

Organization

P
Peking University
Scholars:
1.0W
Papers: 3.8K
Citations: 14.7W
P
pengcheng laboratory
Scholars:
462
Papers: 229
Citations: 0
Cited Papers

Cited Papers

DOLG: Single-Stage Image Retrieval with Deep Orthogonal Fusion of Local and Global Features
err2021-10-01
err0
errOAAI
errMin Yang; Dongliang He; Miao Fan; Baorong Shi; Xuetong Xue; Fu Li; Errui Ding; Jizhou Huang
errShare
errSave
InLoc: Indoor Visual Localization with Dense Matching and View Synthesis
err2018-06-01
err0
errOAAI
errHajime Taira; Masatoshi Okutomi; Torsten Sattler; Mircea Cimpoi; Marc Pollefeys; Josef Sivic; Tomas Pajdla; Akihiko Torii
errShare
errSave
errShare
errSave
Long-Term Visual Localization Revisited
err2022-04-01
err0
errOAAI
errCarl Toft; Will Maddern; Akihiko Torii; Lars Hammarstrand; Erik Stenborg; Daniel Safari; Masatoshi Okutomi; Marc Pollefeys; Josef Sivic; Tomas Pajdla; Fredrik Kahl; Torsten Sattler
errShare
errSave
errShare
errSave
errShare
errSave
researcher View more