.png){kind=icon}
返回
Improving edit-based unsupervised sentence simplification using fine-tuned BERT
.png){kind=icon}
PRE
AI
DOI：10.1016/j.patrec.2023.01.009.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Word suggestion in unsupervised sentence simplification aims to replace complex words of a given sen-tence with their simpler alternatives. This is mostly done without considering their context within the input sentence. In this paper, we propose a technique that brings context awareness to word suggestion by merging pre-trained BERT models with a successful edit-based unsupervised sentence simplification model. More importantly, we show that only by fine-tuning the BERT model on simple English corpora, simplification results can be improved and even outperform some of the competing supervised methods. Finally, we introduce a framework that involves filtering an arbitrary amount of unlabeled in-domain text for tuning the model in situations where labeled data, as simple and complex, is scarce. This preprocess-ing step also speeds up the training process by ignoring fine-tuning on unnecessary samples.(c) 2023 Elsevier B.V. All rights reserved.
Keyword:
Unsupervised sentence simplification
Masked language modeling
Domain adaptation
BERT
Data selection
Natural language processing
期刊
IF:
3.3
论文数:
8.0K
被引数:
1.6W
机构
引用论文
H. pylori eradication with antibiotic treatment causes changes in glucose homeostasis related to modifications in the gut microbiota.png)
PLOS ONE
OAAI
PLOS ONEIF0
OAAI分享收藏 没有更多内容
没有更多内容