arrow
Return

On Learning Interpreted Languages with Recurrent Models

delete2022-06-09
delete3
delete
OA
AI
D
Denis Paperno *
DOI:10.1162/coli_a_00431delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Can recurrent neural nets, inspired by human sequential data processing, learn to understand language? We construct simplified data sets reflecting core properties of natural language as modeled in formal syntax and semantics: recursive syntactic structure and compositionality. We find LSTM and GRU networks to generalize to compositional interpretation well, but only in the most favorable learning settings, with a well-paced curriculum, extensive training data, and left-to-right (but not right-to-left) composition.
Keywords:
NETWORKS

Journal

Computational Linguistics cover
Computational Linguistics
IF:
5.3
Papers:
837
Citations:
2.7K

Organization

U
Utrecht University
Scholars:
6.0W
Papers: 5.1W
Citations: 5.8W