arrow
Return

Syntax-controlled paraphrases generation with VAE and multi-task learning

delete2025-01-01
delete0
PRE
AI
X
Xiyuan Jia
Z
Zongqing Mao
Z
Zhen Zhang *
L
Lv, Qiyun
汪鑫 cover
汪鑫 (Xin Wang)
G
Guohua Wu
DOI:10.1016/j.csl.2024.101705delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Paraphrase generation is an important method for augmenting text data, which has a crucial role in Natural Language Generation (NLG). However, existing methods lack the ability to capture the semantic representation of input sentences and the syntactic structure of exemplars, which can easily lead to problems such as redundant content, semantic inaccuracies, and poor diversity. To tackle these challenges, we propose a Syntax-Controlled Paraphrase Generator (SCPG), which utilizes attention networks and VAE-based hidden variables to model the semantics of input sentences and the syntax of exemplars. In addition, in order to achieve controllability of the target paraphrase structure, we propose a method for learning semantic and syntactic representations based on multi-task learning, and successfully integrate the two through a gating mechanism. Extensive experimental results show that SCPG achieves SOTA results in terms of both semantic consistency and syntactic controllability, and is able to make a better trade-off between preserving semantics and novelty of sentence structure.
Keywords:
Controlled Paraphrase generation
Variational Auto-Encoder
Semantic representation
Syntactic structure
Natural Language Generation

Journal

C
Computer Speech and Language
IF:
3.4
Papers:
1.5K
Citations:
2.6K

Organization

H
Hangzhou Dianzi University
Scholars:
1.3W
Papers: 9.6K
Citations: 7.5K
Cited Papers

Cited Papers

Robust Semantic Communications With Masked VQ-VAE Enabled Codebook
err2023-12-01
err39
errOAAI
errHu, Qiyu; Zhang, Guangyi; Qin, Zhijin; Cai, Yunlong; Yu, Guanding; Li, Geoffrey Ye
errShare
errSave
­Blue mussel (Mytilus spp.) cultivation in mesohaline eutrophied inner coastal waters: mitigation potential, threats and cost effectiveness
err2021-05-20
err0
errOAAI
errLukas Ritzenhofen; Anna-Lucia Buer; Greta Gyraite; Sven Dahlke; Annemarie Klemmstein; Gerald Schernewski
errShare
errSave
errShare
errSave
errShare
errSave
Syntax-Guided Controlled Generation of Paraphrases
err2020-12-01
err45
errOAAI
errKumar, Ashutosh; Ahuja, Kabir; Vadapalli, Raghuram; Talukdar, Partha
errShare
errSave
Simulation in Business and EconomicsPrentice-Hall Inc., 1969
err1969-09-01
err0
PREAI
errRobert C. Meier; William T. Newell; Harold L. Pazer
errShare
errSave
Assessing hyperglycemia avoidance in people with Type 1 diabetes
err2014-05-01
err0
PREAI
errHarsimran Singh; Linda Gonder-Frederick; Karen Schmidt; Derek Ford; Karen A Vajda; Jeffrey Hawley; Daniel J Cox
errShare
errSave
Application of Variational AutoEncoder (VAE) Model and Image Processing Approaches in Game Design
errSENSORS
IF3.5
err2023-03-25
err27
errOAAI
errMak, Hugo Wai Leung; Han, Runze; Yin, Hoover H. F.
errShare
errSave
Neural Machine Translation for Low-resource Languages: A Survey
err2023-02-09
err48
errOAAI
errRanathunga, Surangika; Lee, En-Shiun Annie; Skenduli, Marjana Prifti; Shekhar, Ravi; Alam, Mehreen; Kaur, Rishemjit
errShare
errSave
researcher View more