arrow
返回

Improving tree-based neural machine translation with dynamic lexicalized dependency encoding

delete2020-01-01
delete14
PRE
AI
B
Baosong Yang
D
Derek F. Wong *
L
Lidia S. Chao
张
张民 (Min Zhang)
DOI:10.1016/j.knosys.2019.105042delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Tree-to-sequence neural machine translation models have proven to be effective in learning the semantic representations from the exploited syntactic structure. Despite their success, tree-to-sequence models have two major issues: (1) the embeddings of constituents at the higher tree levels tend to contribute less in translation; and (2) using a single set of model parameters is difficult to fully capture the syntactic and semantic richness of linguistic phrases. To address the first problem, we proposed a lexicalized dependency model, in which the source-side lexical representations are learned in a head-dependent fashion following a dependency graph. Since the number of dependents is variable, we proposed a variant recurrent neural network (RNN) to jointly consider the long-distance dependencies and the sequential information of words. Concerning the second problem, we adopt a latent vector to dynamically condition the parameters for the composition of each node representation. Experimental results reveal that the proposed model significantly outperforms the recently proposed tree-based methods in English-Chinese and English-German translation tasks with even far fewer parameters. (C) 2019 Elsevier B.V. All rights reserved.
Keyword:
Syntactic modeling
Dynamic parameters
Tree-RNN
Neural machine translation (NMT)
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

K
Knowledge-Based Systems
IF:
7.6
论文数:
1.3W
被引数:
4.5W

机构

U
University of Macau
学者数:
1.1W
论文数: 1.3W
被引数: 2.0W
S
soochow university - china
学者数:
5.2W
论文数: 3.6W
被引数: 82
引用论文

引用论文

err分享
err收藏
err分享
err收藏
IQ and Mutual Fund Choice
err2012-01-01
err0
PREAI
errMark Grinblatt; Seppo Ikaheimo; Matti Keloharju; Samuli Knüpfer
err分享
err收藏
学者 查看更多内容