arrow
返回

Adaptive Multi-Compositionality for Recursive Neural Network Models

delete2016-03-01
delete21
PRE
AI
D
Dong Li *
F
Furu Wei
徐
徐科 (Ke Xu) *
S
Shi‐Xia Liu *
M
Ming Zhou *
DOI:10.1109/TASLP.2015.2509257delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Recursive neural network models have achieved promising results in many natural language processing tasks. The main difference among these models lies in the composition function, i.e., how to obtain the vector representation for a phrase or sentence using the representations of words it contains. This paper introduces a novel Adaptive Multi-Compositionality (AdaMC) layer to recursive neural network models. The basic idea is to use more than one composition function and adaptively select them depending on input vectors. We develop a general framework to model the semantic composition as a distribution of these composition functions. The composition functions and parameters used for adaptive selection are jointly learnt from the supervision of specific tasks. We integrate AdaMC into existing recursive neural network models and conduct extensive experiments on the Stanford Sentiment Treebank and semantic relation classification task. The experimental results demonstrate that AdaMC improves the performance of recursive neural network models and outperforms the baseline methods.
Keyword:
Compositionality
neural network
recursive neural network (RNN)
semantic composition
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

I
IEEE-ACM Transactions on Audio Speech and Language Processing
IF:
5.1
论文数:
2.6K
被引数:
1.1W

机构

B
Beihang University
学者数:
5.2W
论文数: 4.1W
被引数: 37
M
Microsoft
学者数:
3.0K
论文数: 2.7K
被引数: 7
M
microsoft china
学者数:
130
论文数: 112
被引数: 0
学者 查看更多机构
引用论文

引用论文

err分享
err收藏
Association Analysis of Genetic Variants in the Myosin IXB Gene in Acute Pancreatitis
err2013-12-30
err0
errOAAI
errRian M. Nijmeijer; Hjalmar C. van Santvoort; Alexandra Zhernakova; Steffen Teller; Jonas A. Scheiber; Carolien G. de Kovel; Marc G. H. Besselink; Jeroen T. J. Visser; Femke Lutgendorff; Thomas L. Bollen; Marja A. Boermeester; Ger T. Rijkers; Frank U. Weiss; Julia Mayerle; Markus M. Lerch; Hein G. Gooszen; Louis M. A. Akkermans; Cisca Wijmenga
err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
Zebrafishdscaml1Deficiency Impairs Retinal Patterning and Oculomotor Function
err2019-11-04
err0
errOAAI
errManxiu Ma; Alexandro D. Ramirez; Tong Wang; Rachel L. Roberts; Katherine E. Harmon; David Schoppik; Avirale Sharma; Christopher Kuang; Stephanie L. Goei; James A. Gagnon; Steve Zimmerman; Shengdar Q. Tsai; Deepak Reyon; J. Keith Joung; Emre R.F. Aksay; Alexander F. Schier; Y. Albert Pan
err分享
err收藏
err分享
err收藏
学者 查看更多内容