.png){kind=icon}
返回
What Do Language Representations Really Represent?
.png){kind=icon}
OA
AI
DOI：10.1162/coli_a_00351.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
A neural language model trained on a text corpus can be used to induce distributed representations of words, such that similar words end up with similar representations. If the corpus is multilingual, the same model can be used to learn distributed representations of languages, such that similar languages end up with similar representations. We show that this holds even when the multilingual corpus has been translated into English, by picking up the faint signal left by the source languages. However, just as it is a thorny problem to separate semantic from syntactic similarity in word representations, it is not obvious what type of similarity is captured by language representations. We investigate correlations and causal relationships between language representations learned from translations on one hand, and genetic, geographical, and several levels of structural similarity between languages on the other. Of these, structural similarity is found to correlate most strongly with language representation similarity, whereas genetic relationships-a convenient benchmark used for evaluation in previous work-appears to be a confounding factor. Apart from implications about translation effects, we see this more generally as a case where NLP and linguistic typology can interact and benefit one another.
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
5.3
论文数:
837
被引数:
2.7K
机构
引用论文
Semi-supervised text classification from unlabeled documents using class associated words利用与类别相关词语从无标签文档进行半监督文本分类
PREAI
分享收藏Evolved structure of language shows lineage-specific trends in word-order universals.png)
NATURE
NATUREIF48.5
PREAI
分享收藏
查看更多内容