arrow
返回

Contrastive Multi-Modal Knowledge Graph Representation Learning

delete2023-09-01
delete8
PRE
AI
Q
Quan Fang
X
Xiaowei Zhang
J
Jun Hu
X
Xian Wu
徐
徐常胜 (Changsheng Xu) *
DOI:10.1109/TKDE.2022.3220625delete
delete原文链接
delete分享
delete收藏
摘要

摘要

En 中文
Representation learning of knowledge graphs (KGs) aims to embed both entities and relations as vectors in a continuous low-dimensional space, which has facilitated various applications such as link prediction and entity retrieval. Most existing KG embedding methods focus on modeling the structured fact triples independently and ignore the multi-type relations among triples as well as the variety of data types (e.g., texts and images) associated with entities in KGs, and thus fail to capture the complex and multi-modal information that is inherently inside the entity-relation triples. In this paper, we propose a novel approach for knowledge graph embedding named Contrastive Multi-modal Graph Neural Network (CMGNN), which can encapsulate comprehensive features from multi-modal content descriptions of entities and high-order connectivity structures. Specifically, CMGNN first learns entity embeddings from multi-modal content and then contrasts encodings from multi-relational local neighbors and high-order connectivities to obtain latent representations of entities and relations simultaneously. Experimental results demonstrate that CMGNN can effectively model the multi-modalities and multi-type structures in KGs, and significantly outperforms existing state-of-the-art methods on benchmark datasets for the tasks of link prediction and entity classification.
Keyword:
Knowledge graph
multimedia
graph neural network
contrastive learning

期刊

IEEE Transactions on Knowledge and Data Engineering 封面图
IEEE Transactions on Knowledge and Data Engineering
IF:
10.4
论文数:
6.9K
被引数:
3.6W

机构

I
institute of automation, cas
学者数:
2.2K
论文数: 2.1K
被引数: 1.6K
Z
Zhengzhou University
学者数:
4.4K
论文数: 1.2K
被引数: 2.4K
C
Chinese Academy of Sciences
学者数:
2.3W
论文数: 6.1K
被引数: 2.6W
学者 查看更多机构
引用论文

引用论文

Targeting of cohesin by transcriptionally silent chromatin
err2005-11-30
err0
errOAAI
errChuang-Rung Chang; Ching-Shyi Wu; Yolanda Hom; Marc R. Gartenberg
err分享
err收藏
DBpedia - A large-scale, multilingual knowledge base extracted from WikipediaDBpedia-从维基百科中提取的大规模多语言知识库
err2015-01-01
err2.0K
errOAAI
errLehmann, Jens; Isele, Robert; Jakob, Max; Jentzsch, Anja; Kontokostas, Dimitris; Mendes, Pablo N.; Hellmann, Sebastian; Morsey, Mohamed; van Kleef, Patrick; Auer, Soeren; Bizer, Christian
err分享
err收藏
A Ranking-Based Meta-Analysis Reveals Let-7 Family as a Meta-Signature for Grade Classification in Breast Cancer
err2015-05-15
err0
errOAAI
errYasemin Oztemur; Tufan Bekmez; Alp Aydos; Isik G. Yulug; Betul Bozkurt; Bala Gur Dedeoglu
err分享
err收藏
Knowledge-Based Topic Model for Multi-Modal Social Event Analysis
err2020-08-01
err23
PREAI
errXue, Feng; Hong, Richang; He, Xiangnan; Wang, Jianwei; Qian, Shengsheng; Xu, Changsheng
err分享
err收藏
Adrenal tumors: An experience of 10 years in a single surgical unit
err2015-01-01
err0
PREAI
errS Khanna; R Priya; SK Bhartiya; S Basu; VK Shukla
err分享
err收藏
学者 查看更多内容