arrow
返回

Semantic Drift in Multilingual Representations

delete2020-11-01
delete11
delete
OA
AI
L
Lisa Beinborn *
R
Rochelle Choenni
DOI:10.1162/coli_a_00382delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Multilingual representations have mostly been evaluated based on their performance on specific tasks. In this article, we look beyond engineering goals and analyze the relations between languages in computational representations. We introduce a methodology for comparing languages based on their organization of semantic concepts. We propose to conduct an adapted version of representational similarity analysis of a selected set of concepts in computational multilingual representations. Using this analysis method, we can reconstruct a phylogenetic tree that closely resembles those assumed by linguistic experts. These results indicate that multilingual distributional representations that are only trained on monolingual text and bilingual dictionaries preserve relations between languages without the need for any etymological information. In addition, we propose a measure to identify semantic drift between language families. We perform experiments on word-based and sentence-based multilingual models and provide both quantitative results and qualitative examples. Analyses of semantic drift in multilingual representations can serve two purposes: They can indicate unwanted characteristics of the computational models and they provide a quantitative means to study linguistic phenomena across languages.

期刊

Computational Linguistics 封面图
Computational Linguistics
IF:
5.3
论文数:
837
被引数:
2.7K

机构

V
Vrije Universiteit Amsterdam
学者数:
4.2W
论文数: 3.7W
被引数: 3.7W
U
university of amsterdam
学者数:
6.0W
论文数: 5.1W
被引数: 94
引用论文

引用论文

err分享
err收藏
err分享
err收藏
err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
What Do Language Representations Really Represent?
err2019-06-01
err29
errOAAI
errBjerva, Johannes; Ostling, Robert; Veiga, Maria Han; Tiedemann, Joerg; Augenstein, Isabelle
err分享
err收藏
YAC transgene-mediated olfactory receptor gene choiceYAC转基因介导的嗅觉受体基因选择
err2000-02-01
err0
errOAAI
errFarah A.W. Ebrahimi; James Edmondson; Rodney Rothstein; Andrew Chess
err分享
err收藏
err分享
err收藏
学者 查看更多内容