.png){kind=icon}
返回
MapReader: a framework for learning a visual language model for map analysis
.png){kind=icon}
PRE
AI
DOI：10.1080/13658816.2025.2455112.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Intelligent map analysis is an important yet challenging topic. Recently, the development of large models, especially Visual Language Models (VLMs), has shown potential for intelligent image analysis. However, these models are primarily trained on natural images, which have intrinsic differences from maps. Consequently, there remains a gap in applying existing general-domain VLMs to map analysis. To address this issue, we propose a framework for developing a specialized VLM, called MapReader. To achieve this goal, a comprehensive data resource is collected using a strategy that combines self-instruct with expert refinement, including training data (MapTrain: 2,000 pairs of maps and descriptions) and evaluation data (MapEval: 250 maps and 500 map-related questions). Based on the training data, MapReader is fine-tuned on top of a general-domain VLM to learn to understand and describe map contents. The evaluation results on MapEval suggest that: (1) MapReader can accept map inputs and generate detailed descriptions of core geographic information, and it also possesses visual question-answering capabilities, showing potential for application in various map analysis scenarios, such as accessible map reading and robotic map usage; (2) The proposed data collection strategy is effective, and the collected dataset can serve as a benchmark to promote further map analysis research.
Keyword:
Map analysis
map understanding
cartography
visual language model
期刊
IF:
5.1
论文数:
2.7K
被引数:
9.3K
机构
引用论文
Patterns in Alpha and Beta Phytoplankton Diversity along a Conductivity Gradient in Coastal Mediterranean Lagoons.png)
Diversity
OAAI
DiversityIF0
OAAI分享收藏The Identification of TP Chromatic Aberration by Using Nearly Equivalent NN Model使用近等价NN模型对TP色差进行识别
PREAI
分享收藏On the afferent projections from some meso-diencephalic nuclei to n. raphe magnus of the rat关于某些中脑-间脑核团向大鼠大缝核的传入投射
PREAI
分享收藏
查看更多内容