arrow
返回

Hyper-node Relational Graph Attention Network for Multi-modal Knowledge Graph Completion

delete2023-02-06
delete22
PRE
AI
S
Shuang Liang
A
Anjie Zhu
J
Jiasheng Zhang
J
Jie Shao *
DOI:10.1145/3545573delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Knowledge graphs often suffer from incompleteness, and knowledge graph completion (KGC) aims at inferring the missing triplets through knowledge graph embedding from known factual triplets. However, most existing knowledge graph embedding methods only use the relational information of knowledge graph and treat the entities and relations as IDs with simple embedding layer, ignoring the multi-modal information among triplets, such as text descriptions, images, etc. In this work, we propose a novel network to incorporate different modal information with graph structure information for more precise representation of multi-modal knowledge graph, termed as hyper-node relational graph attention (HRGAT) network. In HRGAT, we use low-rank multi-modal fusion to model the intra-modality and inter-modality dynamics, which transforms the original knowledge graph to a hyper-node graph. Then, relational graph attention (RGAT) network is used, which contains relation-specific attention and entity-relation fusion operation to capture the graph structure information. Finally, we aggregate the updated multi-modal information and graph structure information to generate the final embeddings of knowledge graph to achieve KGC. By exploring multi-modal information and graph structure information, HRGAT embraces faster convergence speed and achieves the state-of-the-art for KGC on the standard datasets. Implementation code is available at https://github.com/broliang/HRGAT.
Keyword:
Multi-modal knowledge graph
knowledge graph completion
relational graph attention network
low-rank multi-modal fusion

期刊

ACM Transactions on Multimedia Computing Communications and Applications 封面图
ACM Transactions on Multimedia Computing Communications and Applications
IF:
6
论文数:
2.0K
被引数:
5.4K

机构

暂无机构信息
引用论文

引用论文

MobiusE: Knowledge Graph Embedding on Mobius RingMobiusE: Mobius环上的知识图谱嵌入
err2021-09-01
err9
errOAAI
errChen, Yao; Liu, Jiangang; Zhang, Zhe; Wen, Shiping; Xiong, Wenjun
err分享
err收藏
Wikidata: A Free Collaborative Knowledgebase
err2014-09-23
err1.9K
errOAAI
errVrandecic, Denny; Kroetzsch, Markus
err分享
err收藏
err分享
err收藏
Learning hyperbolic attention-based embeddings for link prediction in knowledge graphs
err2021-10-01
err21
PREAI
errZeb, Adnan; Ul Haq, Anwar; Chen, Junde; Lei, Zhenfeng; Zhang, Defu
err分享
err收藏
学者 查看更多内容