arrow
返回

A Multi-Modal Entity Alignment Method with Inter-Modal Enhancement

delete2023-04-18
delete2
delete
OA
AI
S
Song Yuan
Z
Zexin Lu
Q
Qiyuan Li
J
Jinguang Gu *
DOI:10.3390/bdcc7020077delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Due to inter-modal effects hidden in multi-modalities and the impact of weak modalities on multi-modal entity alignment, a Multi-modal Entity Alignment Method with Inter-modal Enhancement (MEAIE) is proposed. This method introduces a unique modality called numerical modality in the modal aspect and applies a numerical feature encoder to encode it. In the feature embedding stage, this paper utilizes visual features to enhance entity relation representation and influence entity attribute weight distribution. Then, this paper introduces attention layers and contrastive learning to strengthen inter-modal effects and mitigate the impact of weak modalities. In order to evaluate the performance of the proposed method, experiments are conducted on three public datasets: FB15K, DB15K, and YG15K. By combining the datasets in pairs, compared with the current state-of-the-art multi-modal entity alignment models, the proposed model achieves a 2% and 3% improvement in Top-1 Hit Rate(Hit@1) and Mean Reciprocal Rank (MRR), demonstrating its feasibility and effectiveness.
Keyword:
multi-modal entity alignment
feature encoding
inter-modal effects
contrastive learning
attention

期刊

B
Big Data and Cognitive Computing
IF:
4.4
论文数:
1.3K
被引数:
2.4K

机构

暂无机构信息
引用论文

引用论文

Present Status of Theory: 1/N Approach
err1984-01-01
err0
PREAI
errPhilip W. Anderson
err分享
err收藏
Knowledge-Driven Cybersecurity Intelligence: Software Vulnerability Coexploitation Behavior Discovery
err2023-04-01
err33
PREAI
errYin, Jiao; Tang, MingJian; Cao, Jinli; You, Mingshan; Wang, Hua; Alazab, Mamoun
err分享
err收藏
Study of the mechanical and microstructural state of platinum thin films
err1996-01-01
err0
PREAI
errV. Branger; V. Pelosin; K.F. Badawi; Ph. Goudeau
err分享
err收藏
A Geo-Data Science Method for Assessing Unconventional Rare-Earth Element Resources in Sedimentary Systems
err2023-02-28
err0
errOAAI
errC. G. Creason; D. Justman; K. Rose; S. Montross; A. Bean; M. Mark-Moser; P. Wingo; M. Sabbatino; R. B. Thomas
err分享
err收藏
Seasonal variation in conception and various pregnancy outcomes
err1986-03-01
err0
PREAI
errCharles W. Warren; Marta L. Gwinn; George L. Rubin
err分享
err收藏
Richpedia: A Large-Scale, Comprehensive Multi-Modal Knowledge Graph
err2020-12-01
err66
PREAI
errWang, Meng; Wang, Haofen; Qi, Guilin; Zheng, Qiushuo
err分享
err收藏
学者 查看更多内容