arrow
返回

Phrase based code-switching for cross-lingual question understanding

delete2023-09-20
delete0
PRE
AI
G
Gulizada Haisa
W
Wen Li
DOI:10.1007/s11042-023-16909-2delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Cross-lingual question understanding involves identifying named entities and question intent in the target language based on corresponding texts from the source-language training dataset. However, relying solely on bilingual parallel corpora has limitations, especially for low-resource languages where such corpora are scarce or unavailable. This paper argues that current cross-lingual techniques hinder the effectiveness of various phrases, particularly noun phrases and interrogative phrases. To address this, a new code-switching data augmentation method called PBCS is introduced for zero-shot cross-lingual training. Unlike recent methods, this approach utilizes small bilingual phrase dictionaries instead of relying on a large bilingual parallel corpus. Moreover, a cross-lingual question understanding model, XQUM, is proposed. At the lower level, the model shares input features and hidden layer states to mitigate error accumulation. Additionally, at the top level, model performance is enhanced through a bi-directional correlation layer based on an iterative mechanism, specifically tailored for the given task. Experimental results on the MQUC and MTOD datasets demonstrate that XQUM significantly improves the accuracy of cross-lingual question understanding tasks.
Keyword:
Cross-lingual
Question understanding
Phrase
NER
QC
Zero-shot

期刊

Multimedia Tools and Applications 封面图
Multimedia Tools and Applications
IF:
3
论文数:
2.0W
被引数:
3.2W

机构

X
Xinjiang University
学者数:
1.4W
论文数: 8.7K
被引数: 1.1W
引用论文

引用论文

err分享
err收藏
Boreal and Temperate Trees in a Changing Climate
err
IF0
err2016-01-01
err0
PREAI
errHeikki Hänninen
err分享
err收藏
Area-Level Disparities of Public Open Space: A Geographic Information Systems Analysis in Metropolitan Melbourne
err2014-12-03
err0
PREAI
errSuzanne Mavoa; Mohammad Javad Koohsari; Hannah M. Badland; Melanie Davern; Xiaoqi Feng; Thomas Astell-Burt; Billie Giles-Corti
err分享
err收藏
Reduction Mammaplasty for Phyllodes Tumor Causing Asymmetry in an Adolescent Female
err2003-09-01
err0
errOAAI
errMustafa Yilmaz; Haluk Vayvada; Adnan Menderes; Cenk Demirdover; Ali Barutcu
err分享
err收藏
学者 查看更多内容