arrow
Return

MapFM: Foundation Model-Driven HD Mapping with Multi-task Contextual Learning

delete2026-01-01
delete0
PRE
AI
L
Leonid M. Ivanov *
V
Vasily Yuryev
D
Dmitry Yudin
DOI:10.1007/978-3-032-08462-0_3delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In autonomous driving, high-definition (HD) maps and semantic maps in birds-eye view (BEV) are essential for accurate localization, planning, and decision-making. This paper introduces an enhanced End-to-End model named MapFM for online vectorized HD map generation. We show significantly boost feature representation quality by incorporating powerful foundation model for encoding camera images. To further enrich the models understanding of the environment and improve prediction quality, we integrate auxiliary prediction heads for semantic segmentation in the BEV representation. This multi-task learning approach provides richer contextual supervision, leading to a more comprehensive scene representation and ultimately resulting in higher accuracy and improved quality of the predicted vectorized HD maps. We have significant increase (+2.7%) in mean average precision (mAP) compared to baseline on the nuScenes dataset. The source code is available at https://github.com/LIvanoff/MapFM.
Keywords:
High-Definition Map
Foundation model
Neural network
Multi-Task learning

Journal

H
HYBRID ARTIFICIAL INTELLIGENT SYSTEMS, HAIS 2025, PT II
IF:
0
Papers:
28
Citations:
0

Organization

M
moscow institute of physics & technology
Scholars:
4.5K
Papers: 3.0K
Citations: 3
Cited Papers

Cited Papers

Leveraging Enhanced Queries of Point Sets for Vectorized Map Construction
err2024-09-30
err0
PREAI
errZihao Liu; Xiaoyu Zhang; Guangwei Liu; Ji Zhao; Ningyi Xu
errShare
errSave
Emerging Properties in Self-Supervised Vision Transformers
err2021-10-01
err0
errOAAI
errMathilde Caron; Hugo Touvron; Ishan Misra; Herve Jegou; Julien Mairal; Piotr Bojanowski; Armand Joulin
errShare
errSave
The effectiveness of MAE pre-pretraining for billion-scale pretraining
err2023-10-01
err0
errOAAI
errMannat Singh; Quentin Duval; Kalyan Vasudev Alwala; Haoqi Fan; Vaibhav Aggarwal; Aaron Adcock; Armand Joulin; Piotr Dollár; Christoph Feichtenhofer; Ross Girshick; Rohit Girdhar; Ishan Misra
errShare
errSave
End-to-End Object Detection with Transformers
err2020-11-03
err0
PREAI
errNicolas Carion; Francisco Massa; Gabriel Synnaeve; Nicolas Usunier; Alexander Kirillov; Sergey Zagoruyko
errShare
errSave
BEVCar: Camera-Radar Fusion for BEV Map and Object Segmentation
err
IF0
err2024-10-14
err0
PREAI
errJonas Schramm; Niclas Vödisch; Kürsat Petek; B Ravi Kiran; Senthil Yogamani; Wolfram Burgard; Abhinav Valada
errShare
errSave
ADMap: Anti-disturbance Framework for Vectorized HD Map Construction
err2024-10-22
err0
PREAI
errHaotian Hu; Fanyi Wang; Yaonong Wang; Laifeng Hu; Jingwei Xu; Zhiwang Zhang
errShare
errSave
SuperFusion: Multilevel LiDAR-Camera Fusion for Long-Range HD Map Generation
err2024-05-13
err0
errOAAI
errHao Dong; Weihao Gu; Xianjing Zhang; Jintao Xu; Rui Ai; Huimin Lu; Juho Kannala; Xieyuanli Chen
errShare
errSave
MapTracker: Tracking with Strided Memory Fusion for Consistent Vector HD Mapping
err2024-10-02
err0
PREAI
errJiacheng Chen; Yuefan Wu; Jiaqi Tan; Hang Ma; Yasutaka Furukawa
errShare
errSave
researcher View more