.png){kind=icon}
返回
Sentence alignment using local and global information
.png){kind=icon}
PRE
AI
DOI：10.1016/j.csl.2016.03.002.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Parallel corpora are essential resources for statistical machine translation (SMT) and cross language information retrieval (CLIR) systems. Creating parallel corpora is highly expensive in terms of both time and cost. In this paper, we propose a novel approach to automatically extract parallel sentences from aligned documents. To do so, we first train a Maximum Entropy binary classifier to compute the local similarity between each two sentences in different languages. To consider global information (e.g., the position of sentence pairs in the aligned documents), we define an objective function to penalize the cross alignments and then propose an integer linear programming approach to optimize the objective function. In our experiments, we focus on English and Persian Wikipedia articles. The experimental results on manually aligned test data indicate that the proposed method outperforms the baselines, significantly. Furthermore, the extrinsic evaluations of the corpus extracted from Wikipedia on both SMT and CUR systems demonstrate the quality of the extracted parallel sentences. In addition, Experiments on the English German language pair demonstrate that the proposed ILP method is a language-independent sentence alignment approach. The extracted English Persian parallel corpus is freely available for research purposes. (C) 2016 Elsevier Ltd. All rights reserved.
Keyword:
Parallel corpus
Sentence alignment
Bilingual resource
Global information
Integer linear programming
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
C
IF:
3.4
论文数:
1.5K
被引数:
2.6K
机构
引用论文
Dual coordinate descent methods for logistic regression and maximum entropy modelslogistic回归和最大熵模型的双坐标下降方法.png)
MACHINE LEARNING
OAAI
MACHINE LEARNINGIF2.9
OAAI分享收藏Pharmacy faculty and students' perceptions of standardized patients for objective structured clinical examinations药学教师与学生对于标准化病人客观结构化临床考试的看法
PREAI
分享收藏分享收藏Hydrothermal preparation and low temperature magnetic properties of TbOOH, DyOOH, HoOOH, ErOOH, and YbOOHTbOOH，DyOOH，HoOOH，ErOOH和YbOOH的水热制备和低温磁性
PREAI
分享收藏Pharmacy students’ views on the objective structured clinical examination (OSCE): findings from two Malaysian universities药学学生对客观结构化临床考试（OSCE）的观点：来自马来西亚两所大学的发现OAAI
OAAI分享收藏
查看更多内容