.png){kind=icon}
返回
MGEL: Multigrained Representation Analysis and Ensemble Learning for Text Moderation
.png){kind=icon}
PRE
AI
DOI：10.1109/TNNLS.2021.3137045.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
In this work, we describe our efforts in addressing two typical challenges involved in the popular text classification methods when they are applied to text moderation: the representation of multibyte characters and word obfuscations. Specifically, a multihot byte-level scheme is developed to significantly reduce the dimension of one-hot character-level encoding caused by the multiplicity of instance-scarce non-ASCII characters. In addition, we introduce a simple yet effective weighting approach for fusing n-gram features to empower the classical logistic regression. Surprisingly, it outperforms well-tuned representative neural networks greatly. As a continual effort toward text moderation, we endeavor to analyze the current state-of-the-art (SOTA) algorithm bidirectional encoder representations from transformers (BERT), which works well in context understanding but performs poorly on intentional word obfuscations. To resolve this crux, we then develop an enhanced variant and remedy this drawback by integrating byte and character decomposition. It advances the SOTA performance on the largest abusive language datasets as demonstrated by our comprehensive experiments. Our work offers a feasible and effective framework to tackle word obfuscations.
Keyword:
Encoding
Social networking (online)
Hate speech
Bit error rate
Vocabulary
Machine learning
Blogs
Abusive language detection
hate speech
multibyte characters
text moderation
word obfuscations
期刊
IF:
8.9
论文数:
7.6K
被引数:
7.2W
机构
引用论文
Repeated and Time-Correlated Morphological Convergence in Cave-Dwelling Harvestmen (Opiliones, Laniatores) from Montane Western North America.png)
PLoS ONE
OAAI
PLoS ONEIF0
OAAI分享收藏
查看更多内容