.png){kind=icon}
返回
A crisis event classification method based on a multimodal multilayer graph model
.png){kind=icon}
PRE
AI
DOI：10.1016/j.neucom.2024.129271.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Quickly obtaining and classifying relevant information about crisis events via social media platforms, such as Twitter and Weibo, plays a critical role in the subsequent rescue operations and post-disaster reconstruction. Current crisis event classification technologies are unable to comprehensively acquire data and are not applicable to a wide range of scenarios. To address this issue, this paper proposes a crisis event prediction method based on a multi-information multimodal deep graph model. Exploring multimodal graph information innovatively and deeply enhances the effectiveness and broadens the applicability of predicting crisis events. First, Bi-LSTM and a GCN structure based on word graphs are used to obtain the sentence and grammatical information of the text, constructing a text feature vector. The image feature vector is constructed by combining a CNN and a Transformer. Second, a graph of the text group and a graph of the image group are constructed on the basis of cosine similarity, and a multilayer structure combining autoencoders and a GCN is used to mine the integrated information of the data. Finally, multimodal feature vectors are converted into a multimodal semantic network, and a multilayer GCN structure with an attention mechanism is employed for crisis event classification prediction. The experimental results on the CrisisMMD dataset and its generated datasets demonstrate that the proposed model outperforms the current state-of-the-art models.
Keyword:
Multimodal crisis event prediction
Grammatical features
Attention mechanism
Autoencoder
Integrated information
Multilayer
Multimodal semantic network
期刊
IF:
6.5
论文数:
2.5W
被引数:
6.5W
机构
引用论文
Toward Clarity in Single Extracellular Vesicle Research: Defining the Field and Correcting Missteps朝向单细胞外囊泡研究的清晰化：界定领域与纠正误步.png)
ACS NANO
OAAI
ACS NANOIF16
OAAI分享收藏A dynamic programming approach to missing data estimation using neural networks使用神经网络进行缺失数据估计的动态规划方法
PREAI
分享收藏MSRL-Net: A multi-level semantic relation-enhanced learning network for aspect-based sentiment analysisMsrl-net: 用于基于方面的情感分析的多级语义关系增强学习网络
OAAI
OAAI分享收藏Identifying disaster related social media for rapid response: a visual-textual fused CNN architecture识别与灾难相关的社交媒体以实现快速响应: 视觉-文本融合的CNN架构OAAI
OAAI分享收藏DeepSDC: Deep Ensemble Learner for the Classification of Social-Media Flooding EventsSUSTAINABILITYOAAI
SUSTAINABILITYIF3.3
OAAI分享收藏
查看更多内容