.png){kind=icon}
返回
CHARM: An Improved Method for Chinese Precoding and Character-Level Embedding
.png){kind=icon}
OA
AI
DOI：10.1109/ACCESS.2021.3112190.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
The numerical transformation of text is a key step in natural language processing tasks, among which the word embedding model is the most representative. However, the word embedding model is insufficient in representing unregistered and low-frequency words, and the character-level embedding model makes up for it. Most Chinese character-level models focus on the independent use of Chinese character features such as strokes, radicals, and pinyin, or the shallow correlations between some features, while the inherent correlations among different features such as pronunciation, glyph, stroke order, and word frequency are not fully utilized. Through the statistical analyses of various features of Chinese characters, this paper proposes a precoding method based on Character Helix Alternative Representation Model (CHARM), which can realize the reversible mapping of Chinese characters or words to English-like sequences, and the advantage of this method is verified in three tasks: text classification, named entity recognition and machine translation. Experimental results on several test sets show that the model performs well, and can be a replacement character-level corpus for the original Chinese text.
Keyword:
Task analysis
Codes
Semantics
Precoding
Text categorization
Context modeling
Numerical models
Chinese text
character level
representation
precoding
期刊
IF:
3.6
论文数:
9.8W
被引数:
29.4W
机构
引用论文
Repeated and Time-Correlated Morphological Convergence in Cave-Dwelling Harvestmen (Opiliones, Laniatores) from Montane Western North America.png)
PLoS ONE
OAAI
PLoS ONEIF0
OAAI分享收藏分享收藏分享收藏Cobalt and Copper Composite Oxides as Efficient Catalysts for Preferential Oxidation of CO in H2-Rich Stream钴和铜复合氧化物作为H2-Rich流中CO优先氧化的有效催化剂
PREAI
分享收藏
查看更多内容