arrow
Return

Abstractive document summarization via multi-template decoding

delete2022-01-08
delete5
PRE
AI
黄于欣 cover
黄于欣 (Yuxin Huang)
余正涛 cover
余正涛 (Zhengtao Yu) *
郭军军 cover
郭军军 (Junjun Guo)
Y
Yan Xiang
于志强 (Zhiqiang Yu)
线岩团 cover
线岩团 (Yantuan Xian)
DOI:10.1007/s10489-021-02607-9delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Most previous abstractive summarization models generate the summary in a left-to-right manner without making the most use of target-side global information. Recently, many researchers seek to alleviate this issue by retrieving target-side templates from large-scale training corpus, yet have limitations in template quality. To overcome the problem of template selection bias, one promising direction is to get better target-side global information from multiple high-quality templates. Hence, this paper extends the encoder-decoder framework by introducing a multi-template decoding mechanism, which can utilize multiple templates retrieved from the training corpus based on the semantic distance. In addition, we introduce a multi-granular attention mechanism by simultaneously taking into account the importance of words in templates and the importance of different templates. Extensive experiment results on CNN/Daily mail and English Gigaword show that our proposed model significantly outperforms several state-of-the-art abstractive and extractive baseline models.
Keywords:
Abstractive document summarization
Multiple templates
Target-side global information
Multi-granular attention

Journal

Applied Intelligence cover
Applied Intelligence
IF:
3.5
Papers:
7.5K
Citations:
1.7W

Organization

No organization information available