arrow
Return

Factuality Guided Diffusion-Based Abstractive Summarization

delete2024-01-01
delete0
delete
OA
AI
J
Jeongwan Shin
H
Hyeyoung Park
H
Hyun-Je Song *
DOI:10.1109/ACCESS.2024.3467063delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
ive summarization models are required to generate summaries that maintain factual consistency with the source text and exhibit high diversity to be applicable in practical applications. Existing models, which are based on pre-trained sequence-to-sequence or text diffusion approaches, generally struggle to balance these aspects, as emphasizing one typically compromises the other. To achieve both factual consistency and high diversity in summarization, this paper proposes a factuality-guided diffusion-based abstractive summarization model. This model integrates a factuality-guided module into the diffusion-based model. As the diffusion-based summarization model generates a high-diversity summary by denoising from random noise, the module guides the noise toward factual consistency with the source text. The proposed method continually guides factuality into the intermediate noise at each denoising step, thereby generating summaries that are not only consistent with the source text but also high in diversity. To guide factuality during the denoising step, this study also introduces a method for calculating the factuality based on token-level contextual matching between the source text and the intermediate noise. The effectiveness of the proposed factuality-guided summarization model is validated on three benchmark datasets, and experimental results demonstrate that the summaries generated by the proposed model are more factually consistent and diverse than those generated by baseline models.
Keywords:
diverse text summarization
factuality-guided summarization
factually consistency in abstractive summarization
Diffusion-based abstractive summarization
diverse text summarization
factuality-guided summarization
factually consistency in abstractive summarization

Journal

IEEE Access cover
IEEE Access
IF:
3.6
Papers:
9.8W
Citations:
29.4W

Organization

K
kyungpook national university (knu)
Scholars:
1.8W
Papers: 1.8W
Citations: 14
J
Jeonbuk National University
Scholars:
1.3W
Papers: 1.3W
Citations: 1.3W
Cited Papers

Cited Papers

The phase separation-dependent FUS interactome reveals nuclear and cytoplasmic function of liquid-liquid phase separation
err
IF0
err2019-10-15
err0
errOAAI
errStefan Reber; Helen Lindsay; Anny Devoy; Daniel Jutzi; Jonas Mechtersheimer; Michal Domanski; Oliver Mühlemann; Silvia M.L. Barabino; Marc-David Ruepp
errShare
errSave
At-birth vaccination timeliness: An analysis of inborns in the highlands of Jos, North-Central Nigeria
err2020-01-01
err0
errOAAI
errSDavid Danjuma; AIshaya Ibrahim; NathanYakubu Shehu; MUdochukwu Diala; CVictor Pam; ChristopherO Ogbodo
errShare
errSave
Interaction of Tau Isoforms with Alzheimer's Disease Abnormally Hyperphosphorylated Tau and in VitroPhosphorylation into the Disease-like Protein
err2001-10-01
err0
errOAAI
errAlejandra del C. Alonso; Tanweer Zaidi; Michal Novak; Hector S. Barra; Inge Grundke-Iqbal; Khalid Iqbal
errShare
errSave
err
IF0
err
err0
PREAI
err
errShare
errSave
researcher View more