.png){kind=icon}
返回
Transformer-based highlights extraction from scientific papers
.png){kind=icon}
PRE
AI
DOI：10.1016/j.knosys.2022.109382.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Highlights are short sentences used to annotate scientific papers. They complement the abstract content by conveying the main result findings. To automate the process of paper annotation, highlights extraction aims at extracting from 3 to 5 paper sentences via supervised learning. Existing approaches rely on ad hoc linguistic features, which depend on the analyzed context, and apply recurrent neural networks, which are not effective in learning long-range text dependencies. This paper leverages the attention mechanism adopted in transformer models to improve the accuracy of sentence relevance estimation. Unlike existing approaches, it relies on the end-to-end training of a deep regression model. To attend patterns relevant to highlights content it also enriches sentence encodings with a section-level contextualization. The experimental results, achieved on three different benchmark datasets, show that the designed architecture is able to achieve significant performance improvements compared to the state-of-the-art. (c) 2022 Published by Elsevier B.V.
Keyword:
Highlights extraction
Transformer model
Extractive summarization
期刊
K
IF:
7.6
论文数:
1.3W
被引数:
4.5W
机构
引用论文
分享收藏Design options for improving protective gloves for industrial assembly work.png)
APPLIED ERGONOMICS
APPLIED ERGONOMICSIF3.4
PREAI
分享收藏Development of simple strike-slip fault zones, Mount Abbot quadrangle, Sierra Nevada, California
PREAI
分享收藏分享收藏
没有更多内容
没有更多内容