.png){kind=icon}
.png){kind=icon}
Return
Noise-augmented multi-modal entity alignment with confidence-based dynamic fusion
.png){kind=icon}
PRE
AI
X
Y
M
K
W
Z
DOI：10.1007/s11432-025-4721-2.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Multi-modal entity alignment seeks to match equivalent entities across different multi-modal knowledge graphs, which integrate heterogeneous multi-modal data such as images and text to enrich entity semantics. However, variations in multi-modal data quality and their inherent unreliability present significant challenges that can negatively impact alignment results. Consequently, we propose NoCo, a noise-augmented multi-modal entity alignment method with confidence-based dynamic fusion. NoCo incorporates a modality-aware noise enhancement mechanism that adaptively injects Gaussian noise into each modality, thereby improving robustness and preventing overfitting to unreliable features. Simultaneously, a confidence-based dynamic fusion framework is designed to automatically calibrate modality contributions according to data quality, effectively down-weighting noisy inputs while amplifying reliable signals. Experimental evaluations demonstrate that NoCo effectively overcomes these challenges and achieves strong performance. Compared with the state-of-the-art method, NoCo achieves a 2.8% maximum improvement on the Multi-OpenEA datasets, 4.1% maximum improvement on FB15K-DB15K, and 5.0% on FB15K-YG15K. The code of the proposed model is stored at https://github.com/HubuKG/NoCo .
Keywords:
multi-modal knowledge graphs
multi-modal entity alignment
dynamic fusion
Journal
IF:
7.6
Papers:
4.9K
Citations:
8.9K
Organization
Cited Papers