Exploring Diverse Features for Statistical Machine Translation Model Pruning

doi:10.1109/TASLP.2015.2456413

Exploring Diverse Features for Statistical Machine Translation Model Pruning

2015-11-01

5

PRE

AI

DOI：10.1109/TASLP.2015.2456413

原文链接

原文求助

摘要

En 中文

In phrase-based and hierarchical phrase-based statistical machine translation systems, translation performance depends heavily on the size and quality of the translation table. To meet the requirements of making a real-time response, some research has been performed to filter the translation table. However, most existing methods are always based on one or two constraints that act as hard rules, such as not allowing phrase-pairs with low translation probabilities. These approaches sometimes make constraints rigid because they consider only a single factor instead of composite factors. Based on the considerations above, in this paper, we propose a machine learning-based framework that integrates multiple features for translation model pruning. Experimental results show that our framework is effective by pruning 80% of the phrase-pairs and 70% of the hierarchical rules, while retaining the quality of the translation models when using the BLEU evaluation metric. Our study further shows that our method can select the most useful phrase-pairs and rules, including those that are low in frequency but still very useful.

Keyword:

Classification

statistical machine translation (SMT)

syntactic constraints

translation model pruning

Exploring Diverse Features for Statistical Machine Translation Model Pruning

摘要

AI总结

期刊

机构