.png){kind=icon}
返回
Word recommendation for English composition using big corpus data processing
.png){kind=icon}
PRE
AI
DOI：10.1007/s10586-018-1916-6.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Writing essays and technical documents can be a challenging task for many people, especially for non-native speakers. Good content and ideas are both important in writing, but clear and effective expressions that can accurately convey the meaning of these ideas to the readers are essential for good writing. Many writers often face difficulty in selecting the proper words that would fit into their sentences. Proper words may be widely used words that appear in similar contexts. These can be identified by a statistical analysis of a corpus, which is a collection of a large number of sentences. This paper propses a method that can recommend suitable words based on word pattern queries, which are expressed as a combination of words, part-of-speech (POS) tags, and wild card words, such as ' {1:2} idea.' The proposed method enables to recommend some words for the POS tags of a word pattern query, along with their popularity and example sentences in a corpus. To facilitate such query processing, the method first conducts the POS tagging for all the sentences in a corpus. From the tagged sentences, it generates the 2-grams up to 5-grams, which consist of words, POS tags, and the special wild card word symbol '*'. It then builds an inverted file-like data structure which keeps the relevant information for each potential word pattern from the n-grams. Due to the large number of word patterns and sentences, the MapReduce algorithms are developed to realize the proposed method and HBase are deployed to manage the inverted file-like data structure. Some experiment results are presented to show the characteristics of the proposed method.
Keyword:
Big data
Pattern query
Word recommendataion
MapReduce
HBase
Natural language processing
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
C
IF:
4.1
论文数:
5.1K
被引数:
7.5K
机构
引用论文
An overview of power topologies for micro-hydro turbines.png)
2012 3rd IEEE International Symposium on Power Electronics for Distributed Generation Systems (PEDG)
2012 3rd IEEE International Symposium on Power Electronics for Distributed Generation Systems (PEDG)IF0
PREAI
分享收藏
分享收藏
查看更多内容