arrow
Return

Knowledge-Enhanced Graph Topic Transformer for Explainable Biomedical Text Summarization

delete2024-04-01
delete6
PRE
AI
Q
Qianqian Xie *
P
Prayag Tiwari
S
Sophia Ananiadou
DOI:10.1109/JBHI.2023.3308064delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Given the overwhelming and rapidly increasing volumes of the published biomedical literature, automatic biomedical text summarization has long been a highly important task. Recently, great advances in the performance of biomedical text summarization have been facilitated by pre-trained language models (PLMs) based on fine-tuning. However, existing summarization methods based on PLMs do not capture domain-specific knowledge. This can result in generated summaries with low coherence, including redundant sentences, or excluding important domain knowledge conveyed in the full-text document. Furthermore, the black-box nature of the transformers means that they lack explainability, i.e. it is not clear to users how and why the summary was generated. The domain-specific knowledge and explainability are crucial for the accuracy and transparency of biomedical text summarization methods. In this article, we aim to address these issues by proposing a novel domain knowledge-enhanced graph topic transformer (DORIS) for explainable biomedical text summarization. The model integrates the graph neural topic model and the domain-specific knowledge from the Unified Medical Language System (UMLS) into the transformer-based PLM, to improve the explainability and accuracy. Experimental results on four biomedical literature datasets show that our model outperforms existing state-of-the-art (SOTA) PLM-based summarization methods on biomedical extractive summarization. Furthermore, our use of graph neural topic modeling means that our model possesses the desirable property of being explainable, i.e. it is straightforward for users to understand how and why the model selects particular sentences for inclusion in the summary. The domain-specific knowledge helps our model to learn more coherent topics, to better explain the performance.
Keywords:
Biomedical text summarization
domain knowledge
graph neural topic model
explainability
pre-trained language models

Journal

IEEE Journal of Biomedical and Health Informatics cover
IEEE Journal of Biomedical and Health Informatics
IF:
6.8
Papers:
4.6K
Citations:
2.0W

Organization

H
Halmstad University
Scholars:
948
Papers: 930
Citations: 995
U
University of Manchester
Scholars:
5.7W
Papers: 5.3W
Citations: 7.4W
Cited Papers

Cited Papers

SCALING WITH KNOWN UNCERTAINTY: A SYNTHESIS
err2006-01-01
err0
PREAI
errJIANGUO WU; HARBIN LI; K. BRUCE JONES; ORIE L. LOUCKS
errShare
errSave
Scalable empirical mixture models that account for across-site compositional heterogeneity
err
IF0
err2019-10-07
err0
errOAAI
errDominik Schrempf; Nicolas Lartillot; Gergely Szöllősi
errShare
errSave
Matrix Effects in the Detection of Pb and Ba in Soils Using Laser-Induced Breakdown Spectroscopy
err1996-09-01
err0
PREAI
errAaron S. Eppler; David A. Cremers; Donald D. Hickmott; Monty J. Ferris; Aaron C. Koskelo
errShare
errSave
errShare
errSave
Characterization of monoclonal antibodies against hantavirus nucleocapsid protein and their use for immunohistochemistry on rodent and human samples
err2010-12-16
err0
errOAAI
errIndre Kucinskaite-Kodze; Rasa Petraityte-Burneikiene; Aurelija Zvirbliene; Brian Hjelle; Rafael A. Medina; Alma Gedvilaite; Ausra Razanskiene; Jonas Schmidt-Chanasit; Marc Mertens; Paula Padula; Kestutis Sasnauskas; Rainer G. Ulrich
errShare
errSave
ELSA: Entropy-based local indicator of spatial association
err2019-03-01
err0
errOAAI
errBabak Naimi; Nicholas A.S. Hamm; Thomas A. Groen; Andrew K. Skidmore; Albertus G. Toxopeus; Sara Alibakhshi
errShare
errSave
Text summarization in the biomedical domain: A systematic review of recent research
err2014-12-01
err135
errOAAI
errMishra, Rashmi; Bian, Jiantao; Fiszman, Marcelo; Weir, Charlene R.; Jonnalagadda, Siddhartha; Mostafa, Javed; Del Fiol, Guilherme
errShare
errSave
researcher View more