Unsupervised morphological segmentation based on affixality measurements

doi:10.1016/j.patrec.2016.09.001

Unsupervised morphological segmentation based on affixality measurements

2016-12-01

2

PRE

AI

C

Carlos-Francisco Méndez-Cruz *

DOI：10.1016/j.patrec.2016.09.001

原文链接

原文求助

摘要

En 中文

In this paper, we present a method for unsupervised morphological segmentation for multi-slot morphology based on affixality measurements. These measurements quantify three linguistic characteristics of affixes: (1) they combine with many low frequency word-bases (high combinatorial capacity), (2) although they are relatively few, they help to maximize the size of a lexicon (economy principle), i. e. speakers know more words by remembering fewer morphological items, and (3) they are very frequent, so they contain less information than word-bases (entropy), i. e. borders between affixes and stems can be detected by finding entropy peaks. Several experiments combining these measurements were conducted to find the best way to apply them to data. The best strategy consists in successive segmentation when the average of the affixality measurements surpasses a threshold of 0.5. Also, we compared this strategy with some state-of-the-art methods for unsupervised morphological segmentation (Morfessor and ParaMor). Our method outperformed these methods, when tested in a hand-made corpus. Results indicate that our proposal is competitive at least for the morphological segmentation of Spanish words. (C) 2016 Elsevier B. V. All rights reserved.

Keyword:

Unsupervised learning

Morphological Segmentation

Affixality measurements

Morphology induction

Morpheme segmentation

Information retrieval

Unsupervised morphological segmentation based on affixality measurements

摘要

AI总结

期刊

机构

引用论文