返回
Improving generation diversity via syntax-controlled paraphrasing
DOI:10.1016/j.neucom.2022.02.020.png)
摘要
En 中文
As the neural-based Seq2Seq model pushes the state-of-the-art in text generation, recent work has turned to controlling attributes of the text such models generate, where syntax-controlled text generation can be applied for the paraphrase generation task, i.e., given an input sentence and a syntactic control to generate a paraphrase. The main challenge is how to generate sentences that follow the given syntax while maintaining semantics during the decoding process. Previous approaches using constituency parse trees as syntactic control can achieve better performance, but still suffer from the problems of inaccurate utilization of syntactic information and original semantics loss. To this end, we propose a Syntax Attention -Guided Paraphrase (SAGP) generation model that can utilize the previously generated text to accurately select a syntactic node from the given constituency parse tree to guide the generation of paraphrases. The automatic and manual evaluation results on the public datasets of syntactically controlled paraphrase generation task show that SAGP achieves state-of-the-art results in both syntactic controllability and semantic consistency. In order to improve the semantic consistency, we further propose a coarse-grained syntactic control definition method, which first removes the part-of speech node and then extracts higher-level subtrees as control, so that meaningful paraphrases can be generated within a loose constraint. The experimental results on the same evaluation set show that the coarse-grained syntactic control can significantly improve semantic consistency. (c) 2022 Elsevier B.V. All rights reserved.
Keyword:
Syntax-controlled paraphrasing
Semantic consistency
Syntactic controllability
Coarse-grained Syntactic Control
期刊
IF:
6.5
论文数:
2.5W
被引数:
6.5W
机构
引用论文
Text segmentation for patent claim simplification via Bidirectional Long‐Short Term Memory and Conditional Random Field基于双向长短时记忆网络和条件随机场的专利权利要求文本分割
Blue mussel (Mytilus spp.) cultivation in mesohaline eutrophied inner coastal waters: mitigation potential, threats and cost effectiveness
PeerJ
IF0
Role of Ser457 of NADPH−Cytochrome P450 Oxidoreductase in Catalysis and Control of FAD Oxidation−Reduction Potential
Biochemistry
IF0
SKR-QA: Semantic ranking and knowledge revise for multi-choice question answeringSkr-qa: 多选题问答的语义排序与知识修正
NEUROCOMPUTING
IF6.5

