arrow
返回

Recognizing Unknown Disaster Scenes With Knowledge Graph-Based Zero-Shot Learning (KG-ZSL) Model

delete2024-01-01
delete0
PRE
AI
S
Siyuan Wen
赵文智 (Wenzhi Zhao) *
F
Fengcheng Ji
R
Rui Peng
张立强 (Liqiang Zhang)
王俏 封面图
王俏 (Qiao Wang)
DOI:10.1109/TGRS.2024.3394653delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Unseen category prediction is a common challenge for real-world applications, especially for remote sensing (RS) imagery interpretation. Zero-shot learning (ZSL)-based scene classification methods have made significant progress recently, providing an effective solution for unseen scene recognition with semantic embeddings that link seen and unseen classes in the field of RS. However, existing ZSL methods mainly focus on semantic feature exploration, and they failed to combine image features and semantic features effectively. To address the aforementioned challenges, we propose a novel knowledge graph (KG)-based ZSL model that adeptly integrates both image and semantic features for disaster RS scene recognition. First, we construct an RS KG to generate semantic features of RS scenes, enhancing the reasoning ability from conventional RS scene categories to disaster RS scene categories. Second, we propose an interactive-attention mechanism to integrate image and semantic features, focusing on the most informative regions. Finally, we introduce an RS domain adapter that enables the model to better adapt to RS data, reproject common features into the RS domain, and thus solve zero-shot RS scene classification tasks. To demonstrate the effectiveness of our method, we construct an RS disaster scene dataset, which contains 8700 high-quality disaster scenes. Extensive experiments show that our proposed method outperforms current state-of-the-art (SOTA) methods under zero-shot RS image scene classification settings.
Keyword:
Disaster recognition
remote sensing (RS) scene classification
RS knowledge graph (KG)
zero-shot learning (ZSL)

期刊

IEEE Transactions on Geoscience and Remote Sensing 封面图
IEEE Transactions on Geoscience and Remote Sensing
IF:
8.6
论文数:
2.1W
被引数:
10.7W

机构

B
Beijing Normal University
学者数:
3.3W
论文数: 2.7W
被引数: 4.2W
引用论文

引用论文

Sclerostin deficient mice rapidly heal bone defects by activating β-catenin and increasing intramembranous ossification
err2013-11-01
err0
errOAAI
errMeghan E. McGee-Lawrence; Zachary C. Ryan; Lomeli R. Carpio; Sanjeev Kakar; Jennifer J. Westendorf; Rajiv Kumar
err分享
err收藏
Elements of Quaternions四元数的元素
err
IF0
err2015-07-05
err0
PREAI
errWilliam Rowan Hamilton
err分享
err收藏
err分享
err收藏
Metabolic changes to host cells withToxoplasma gondiiinfection
err
IF0
err2023-08-10
err0
errOAAI
errGina M. Gallego-López; Emmanuel Contreras Guzman; Laura J. Knoll; Melissa Skala
err分享
err收藏
学者 查看更多内容