.png){kind=icon}
.png){kind=icon}
Return
Unsupervised statistical text simplification using pre-trained language modeling for initialization
.png){kind=icon}
PRE
AI
DOI：10.1007/s11704-022-1244-0.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Unsupervised text simplification has attracted much attention due to the scarcity of high-quality parallel text simplification corpora. Recent an unsupervised statistical text simplification based on phrase-based machine translation system (UnsupPBMT) achieved good performance, which initializes the phrase tables using the similar words obtained by word embedding modeling. Since word embedding modeling only considers the relevance between words, the phrase table in UnsupPBMT contains a lot of dissimilar words. In this paper, we propose an unsupervised statistical text simplification using pre-trained language modeling BERT for initialization. Specifically, we use BERT as a general linguistic knowledge base for predicting similar words. Experimental results show that our method outperforms the state-of-the-art unsupervised text simplification methods on three benchmarks, even outperforms some supervised baselines.
Keywords:
text simplification
pre-trained language modeling
BERT
word embeddings
Journal
IF:
4.6
Papers:
1.6K
Citations:
2.8K