arrow
返回

A practical and nuanced framework for entity linking evaluation

delete2026-02-12
delete0
PRE
AI
F
Fuqi Xu
G
Goran Nenadić
R
Robert Stevens *
DOI:10.1186/s13326-025-00339-0delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
背景 实体链接将文本提及项映射到词汇表中的实体。尽管准确性是实体链接评估的主要指标,但它未能捕捉模型行为的复杂性。结果 我们提出了一种实体链接评估框架,该框架明确了指标计算的目标对象,融入了术语层级结构,生成了性能概要,并将其总结为模型特征。该框架强调词汇的层级结构,将关注点从文本级别的标签匹配转向概念间的语义比较。我们通过一项关于疾病实体链接的案例研究来说明该框架的能力和实用性。结论 我们的研究结果表明,将评估指标与特定应用需求对齐的重要性,并为实体链接提供了结构化的层级错误分析,为实体链接系统的更细致和实用的评估铺平了道路。
Keyword:
Entity linking
Evaluation
Hierarchical vocabulary
Benchmarking

期刊

J
Journal of Biomedical Semantics
IF:
2
论文数:
17
被引数:
0

机构

U
University of Manchester
学者数:
5.7W
论文数: 5.3W
被引数: 7.4W
引用论文

引用论文

A Comprehensive Evaluation of Biomedical Entity Linking Models生物医学实体链接模型的全面评估
err2023-01-01
err0
errOAAI
errDavid Kartchner; Jennifer Deng; Shubham Lohiya; Tejasri Kopparthi; Prasanth Bathala; Daniel Domingo-Fernández; Cassie Mitchell
err分享
err收藏
The use of concept maps during knowledge elicitation in ontology development processes – the nutrigenomics use case
err2006-05-25
err0
errOAAI
errAlexander Garcia Castro; Philippe Rocca-Serra; Robert Stevens; Chris Taylor; Karim Nashar; Mark A Ragan; Susanna-Assunta Sansone
err分享
err收藏
Toward a Semantic Granularity Model for Domain-Specific Information Retrieval
err2011-07-22
err126
errOAAI
errYan, Xin; Lau, Raymond Y. K.; Song, Dawei; Li, Xue; Ma, Jian
err分享
err收藏
PubTator central: automated concept annotation for biomedical full text articles
err2019-05-22
err254
errOAAI
errWei, Chih-Hsuan; Allot, Alexis; Leaman, Robert; Lu, Zhiyong
err分享
err收藏
Knowledge-Rich Self-Supervision for Biomedical Entity Linking
err2022-01-01
err0
errOAAI
errSheng Zhang; Hao Cheng; Shikhar Vashishth; Cliff Wong; Jinfeng Xiao; Xiaodong Liu; Tristan Naumann; Jianfeng Gao; Hoifung Poon
err分享
err收藏
National Cancer Institute Thesaurus (NCIt)国家癌症研究所叙词表 (NCIt)
err2023-07-20
err0
PREAI
errSherri de Coronado; Lyubov Remennik; Peter L. Elkin
err分享
err收藏
学者 查看更多内容