Applying a sectioned genetic algorithm to word segmentation

doi:10.1007/s10044-008-0140-z

Return

Applying a sectioned genetic algorithm to word segmentation

2009-01-22

PRE

Zacharias Detorakis *

George Tambouratzis

DOI：10.1007/s10044-008-0140-z

Original

Original request for help

Save

Abstract

En 中文

This article presents a novel approach for morphological analysis based on the concept of genetic algorithms (GAs). Morphological analysis is of critical importance in data mining and information retrieval systems because it leads to a more homogeneous representation of words. The system presented here makes minimal use of language specific information and is therefore more general than the rule-based techniques that have been proposed in literature. A number of heuristics are created and tested as evaluation functions; both general-purpose ones as well as heuristics specifically designed for the task, and decisions are made on the optimum models for the genetic operators suitable for the specific implementation. Finally the system addresses the problem of simultaneous processing of a great number of words without excessively increasing the execution time or deteriorating the segmentation quality of the final results. This is accomplished by the division of the individuals into sections, following the application of a group of masks, and the operation of the GA on these smaller sections instead of on the entire individual.

Keywords:

Morphology

Stem

Suffix

Genetic algorithms

Sections

Masks

Heuristic function

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.