.png){kind=icon}
返回
Fusing semantic information for syntax-guided paraphrase generation
.png){kind=icon}
PRE
AI
DOI：10.1016/j.neucom.2024.128009.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Syntax -guided paraphrase generation (SGPG) refers to generating a paraphrase sentence that satisfies the given syntactic structure without changing the source sentences' semantics. The commonly utilized syntactic structures are part -of -speech (POS) sequence, constituency parse tree, and masked template, with constituency parse tree achieving State -of -The -Art (SOTA) performance because of its rich syntactic information. As a result, further mining of syntactic information in parse trees has grown popular, yet fewer works pay attention to investigating semantic information in source sentences. A sentence is made up of two parts: syntax and semantics. Multiple studies have shown that improving the model's ability to learn semantic information is critical for paraphrase construction as well as syntax learning. In this paper, we propose Fusing Semantic Information for Syntax -guided Paraphrase Generation (FS-SPG). Specifically, we propose a transformer -based semantic encoder to obtain detailed semantics from source sentences. This encoder contains a Semantics -Aware Attention mechanism for mining semantic information. In addition, we apply contrastive learning to improve the accuracy of parse tree nodes' guidance to semantic sentences. Experiments on ParaNMT and QQP-Pos show that our model beats the SOTA model SI-SCP by 4.92% in syntactic metrics and 1.35% in semantic metrics.
Keyword:
Paraphrase generation
Contrastive learning
Semantics and syntax
Transformer
期刊
IF:
6.5
论文数:
2.5W
被引数:
6.5W
机构
引用论文
.png){kind=icon}
分享收藏
Cobalt and Copper Composite Oxides as Efficient Catalysts for Preferential Oxidation of CO in H2-Rich Stream钴和铜复合氧化物作为H2-Rich流中CO优先氧化的有效催化剂
PREAI
分享收藏Designing Amino-Functionalized Metal-Organic Frameworks for Highly Efficient and Selective Separation of Furan Compounds from Water设计氨基功能化的金属有机框架，用于从水中高效且选择性地分离呋喃化合物
PREAI
分享收藏
查看更多内容