返回
Recognizing Unknown Disaster Scenes With Knowledge Graph-Based Zero-Shot Learning (KG-ZSL) Model
DOI:10.1109/TGRS.2024.3394653.png)
摘要
En 中文
Unseen category prediction is a common challenge for real-world applications, especially for remote sensing (RS) imagery interpretation. Zero-shot learning (ZSL)-based scene classification methods have made significant progress recently, providing an effective solution for unseen scene recognition with semantic embeddings that link seen and unseen classes in the field of RS. However, existing ZSL methods mainly focus on semantic feature exploration, and they failed to combine image features and semantic features effectively. To address the aforementioned challenges, we propose a novel knowledge graph (KG)-based ZSL model that adeptly integrates both image and semantic features for disaster RS scene recognition. First, we construct an RS KG to generate semantic features of RS scenes, enhancing the reasoning ability from conventional RS scene categories to disaster RS scene categories. Second, we propose an interactive-attention mechanism to integrate image and semantic features, focusing on the most informative regions. Finally, we introduce an RS domain adapter that enables the model to better adapt to RS data, reproject common features into the RS domain, and thus solve zero-shot RS scene classification tasks. To demonstrate the effectiveness of our method, we construct an RS disaster scene dataset, which contains 8700 high-quality disaster scenes. Extensive experiments show that our proposed method outperforms current state-of-the-art (SOTA) methods under zero-shot RS image scene classification settings.
Keyword:
Disaster recognition
remote sensing (RS) scene classification
RS knowledge graph (KG)
zero-shot learning (ZSL)
期刊
IF:
8.6
论文数:
2.1W
被引数:
10.7W
机构
引用论文
Crystalline‐State Reaction with Allosteric Effect in Spin‐Crossover, Interpenetrated Networks with Magnetic and Optical Bistability具有磁和光学双稳态的自旋交叉,互穿网络中具有变构效应的晶态反应
Deep Learning Classification of Land Cover and Crop Types Using Remote Sensing Data基于遥感数据的土地覆盖和作物类型深度学习分类
Do Perceptions of Competence Mediate The Relationship Between Fundamental Motor Skill Proficiency and Physical Activity Levels of Children in Kindergarten?能力的感知是否可以介导幼儿园儿童的基本运动技能熟练程度与身体活动水平之间的关系?
Research on the Efficiency of Wireless Power Transfer System Based on Multi-Auxiliary Transmitting Coils基于多辅助发射线圈的无线电能传输系统效率研究
Transcatheter occlusion of the persistently patent ductus arteriosus. Forty-month follow-up and prevalence of residual shunting.
Circulation
IF0

