arrow
Return

Improving machine translation performance by exploiting non-parallel corpora

delete2005-12-01
delete179
delete
OA
AI
M
Munteanu, DS
M
Marcu, D
DOI:10.1162/089120105775299168delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
We present a novel method for discovering parallel sentences in comparable, non-parallel corpora. We train a maximum entropy classifier that, given a pair of sentences, can reliably determine whether or not they are translations of each other. Using this approach, we extract parallel data from large Chinese, Arabic, and English non-parallel newspaper corpora. We evaluate the quality of the extracted data by showing that it improves the performance of a state-of-the-art statistical machine translation system. We also show that a good-quality MT system can be built from scratch by starting with a very small parallel corpus (100,000 words) and exploiting a large non-parallel corpus. Thus, our method can be applied with great benefit to language pairs for which only scarce resources are available.
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Computational Linguistics cover
Computational Linguistics
IF:
5.3
Papers:
837
Citations:
2.7K

Organization

No organization information available
Cited Papers

Cited Papers

Direct measurements of two-way wave-particle energy transfer in a collisionless space plasma
err2018-09-07
err0
errOAAI
errN. Kitamura; M. Kitahara; M. Shoji; Y. Miyoshi; H. Hasegawa; S. Nakamura; Y. Katoh; Y. Saito; S. Yokota; D. J. Gershman; A. F. Vinas; B. L. Giles; T. E. Moore; W. R. Paterson; C. J. Pollock; C. T. Russell; R. J. Strangeway; S. A. Fuselier; J. L. Burch
errShare
errSave
The Web as a parallel corpus
err2003-09-01
err284
errOAAI
errResnik, P; Smith, NA
errShare
errSave