arrow
返回

Content Noise Detection Model Using Deep Learning in Web Forums

delete2020-06-22
delete1
delete
OA
AI
J
Jiyoung Woo
J
Jaeseok Yun *
DOI:10.3390/su12125074delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Spam posts in web forum discussions cause user inconvenience and lower the value of the web forum as an open source of user opinion. In this regard, as the importance of a web post is evaluated in terms of the number of involved authors, noise distorts the analysis results by adding unnecessary data to the opinion analysis. Here, in this work, an automatic detection model for spam posts in web forums using both conventional machine learning and deep learning is proposed. To automatically differentiate between normal posts and spam, evaluators were asked to recognize spam posts in advance. To construct the machine learning-based model, text features from posted content using text mining techniques from the perspective of linguistics were extracted, and supervised learning was performed to distinguish content noise from normal posts. For the deep learning model, raw text including and excluding special characters was utilized. A comparison analysis on deep neural networks using the two different recurrent neural network (RNN) models of the simple RNN and long short-term memory (LSTM) network was also performed. Furthermore, the proposed model was applied to two web forums. The experimental results indicate that the deep learning model affords significant improvements over the accuracy of conventional machine learning associated with text features. The accuracy of the proposed model using LSTM reaches 98.56%, and the precision and recall of the noise class reach 99% and 99.53%, respectively.
Keyword:
web forum
social media
content noise
posting quality
text mining
deep learning
machine learning

期刊

Sustainability 封面图
Sustainability
IF:
3.3
论文数:
10.6W
被引数:
28.4W

机构

S
soonchunhyang university
学者数:
7.3K
论文数: 6.1K
被引数: 2
引用论文

引用论文

err分享
err收藏
The Concept of Sustainability on Social Media: A Social Listening Approach
err2020-03-09
err38
errOAAI
errTeresa Ballestar, Maria; Cuerdo-Mir, Miguel; Teresa Freire-Rubio, Maria
err分享
err收藏
err分享
err收藏
Deep learning to filter SMS Spam
err2020-01-01
err101
errOAAI
errRoy, Pradeep Kumar; Singh, Jyoti Prakash; Banerjee, Snehasish
err分享
err收藏
Social Sustainability: A New Conceptual Framework
err2017-01-05
err519
errOAAI
errEizenberg, Efrat; Jabareen, Yosef
err分享
err收藏
What is social sustainability? A clarification of concepts
err2011-06-01
err659
PREAI
errValiance, Suzanne; Perkins, Harvey C.; Dixon, Jennifer E.
err分享
err收藏
The origin of squamates revealed by a Middle Triassic lizard from the Italian Alps
err2018-05-30
err0
PREAI
errTiago R. Simões; Michael W. Caldwell; Mateusz Tałanda; Massimo Bernardi; Alessandro Palci; Oksana Vernygora; Federico Bernardini; Lucia Mancini; Randall L. Nydam
err分享
err收藏
学者 查看更多内容