arrow
返回

Multi-Modal Knowledge Graph Construction and Application: A Survey

delete2024-02-01
delete50
delete
OA
AI
X
Xiangru Zhu
Z
Zhixu Li
X
Xiaodan Wang
X
Xueyao Jiang
P
Penglei Sun
X
Xuwu Wang
Y
Yanghua Xiao *
N
Nicholas Jing Yuan
DOI:10.1109/TKDE.2022.3224228delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Recent years have witnessed the resurgence of knowledge engineering which is featured by the fast growth of knowledge graphs. However, most of existing knowledge graphs are represented with pure symbols, which hurts the machine's capability to understand the real world. The multi-modalization of knowledge graphs is an inevitable key step towards the realization of human-level machine intelligence. The results of this endeavor are Multi-modal Knowledge Graphs (MMKGs). In this survey on MMKGs constructed by texts and images, we first give definitions of MMKGs, followed with the preliminaries on multi-modal tasks and techniques. We then systematically review the challenges, progresses and opportunities on the construction and application of MMKGs respectively, with detailed analyses of the strengths and weaknesses of different solutions. We finalize this survey with open research problems relevant to MMKGs.
Keyword:
Multimodal knowledge graph
survey
symbol grounding

期刊

IEEE Transactions on Knowledge and Data Engineering 封面图
IEEE Transactions on Knowledge and Data Engineering
IF:
10.4
论文数:
6.8K
被引数:
3.2W

机构

F
fudan university
学者数:
11.8W
论文数: 7.7W
被引数: 121
引用论文

引用论文

Parameter-Free Model of the Self-Catalyzed Growth of Ga(As,P) Nanowires
err2022-05-11
err0
PREAI
errN. V. Sibirev; Yu. S. Berdnikov; V. V. Fedorov; I. V. Shtrom; A. D. Bolshakov
err分享
err收藏
Initial clustering after quenching in AlZnMg alloys
err1985-02-01
err0
PREAI
errA. Juhász; I. Kovács; J. Lendvai; P. Tasnádi
err分享
err收藏
err分享
err收藏
Inhibition of Ferroptosis Attenuates Acute Kidney Injury in Rats with Severe Acute Pancreatitis
err2020-03-27
err0
PREAI
errDeliang Ma; Chang Li; Pengling Jiang; Yingjian Jiang; Jiang Wang; Dianliang Zhang
err分享
err收藏
学者 查看更多内容