arrow
返回

Information Dropping Data Augmentation for Machine Translation Quality Estimation

delete2024-01-01
delete1
PRE
AI
S
Shuo Li
X
Xiaojun Bi *
T
Tao Liu
Z
Zheng Chen
DOI:10.1109/TASLP.2024.3380996delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Machine translation quality estimation (QE) refers to the quality assessment of machine translations without a given reference translation. Supervised QE models based on neural networks have achieved state-of-the-art results. But this method requires large-scale training data, which requires bilingual experts to create high-quality labels. This is often very costly. Therefore, we propose a sentence-level machine translation QE data augmentation method based on information dropping. Firstly, we calculate the subwords information of the target translation based on the conditional language model. Subsequently, some subwords in the target translation are randomly deleted or replaced. We obtain the pseudo quality score by calculating the remaining information. Finally, the original and augmented data are combined to train the final model. This pseudo-data generation method based on information dropping strategy enables us to obtain more faithful and diverse training samples without requiring additional corpus resources. Experimental results show that we improve the correlation with human judgment by an average of 5.96% in the seven translation directions of the MLQE-PE dataset, while improving the model's robustness to low adequacy samples. In addition, the method does not require any modifications to the model architecture.
Keyword:
Machine translation
Data augmentation
Data models
Computational modeling
Training data
Estimation
Training
information entropy
machine translation
pseudo label
quality estimation

期刊

I
IEEE-ACM Transactions on Audio Speech and Language Processing
IF:
5.1
论文数:
2.6K
被引数:
1.1W

机构

H
Harbin Engineering University
学者数:
1.9W
论文数: 1.3W
被引数: 1.3W
M
Minzu University of China
学者数:
3.3K
论文数: 1.9K
被引数: 6.7K
引用论文

引用论文

The Ecology of Sumatra苏门答腊的生态
err
IF0
err2023-10-31
err0
PREAI
errTony Whitten; Sengli J Damanik; Janzanul Anwar; Nazaruddin Hisyam
err分享
err收藏
err分享
err收藏
Few-layered metallic 1T-MoS2/TiO2 with exposed (001) facets: two-dimensional nanocomposites for enhanced photocatalytic activities具有暴露的 (001) 面的少层金属1T-MoS2/TiO2: 用于增强光催化活性的二维纳米复合材料
err2017-01-01
err0
PREAI
errHyukSu Han; Kang Min Kim; Chan-Woo Lee; Caroline S. Lee; Rajendra C. Pawar; Jacob L. Jones; Yu-Rim Hong; Jeong Ho Ryu; Taeseup Song; Suk Hyun Kang; Heechae Choi; Sungwook Mhin
err分享
err收藏
Invasive alien plants in Sergipe, north-eastern Brazil塞格ipe(巴西东北部)的入侵性外来植物
err2021-01-29
err0
errOAAI
errJuliano Ricardo Fabricante; Kelianne Carolina Targino de Araújo; Thieres Santos Almeida; João Paulo Bispo Santos; Daniel Oliveira Reis
err分享
err收藏
学者 查看更多内容