arrow
Return

Content Noise Detection Model Using Deep Learning in Web Forums

delete2020-06-22
delete1
delete
OA
AI
J
Jiyoung Woo
J
Jaeseok Yun *
DOI:10.3390/su12125074delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Spam posts in web forum discussions cause user inconvenience and lower the value of the web forum as an open source of user opinion. In this regard, as the importance of a web post is evaluated in terms of the number of involved authors, noise distorts the analysis results by adding unnecessary data to the opinion analysis. Here, in this work, an automatic detection model for spam posts in web forums using both conventional machine learning and deep learning is proposed. To automatically differentiate between normal posts and spam, evaluators were asked to recognize spam posts in advance. To construct the machine learning-based model, text features from posted content using text mining techniques from the perspective of linguistics were extracted, and supervised learning was performed to distinguish content noise from normal posts. For the deep learning model, raw text including and excluding special characters was utilized. A comparison analysis on deep neural networks using the two different recurrent neural network (RNN) models of the simple RNN and long short-term memory (LSTM) network was also performed. Furthermore, the proposed model was applied to two web forums. The experimental results indicate that the deep learning model affords significant improvements over the accuracy of conventional machine learning associated with text features. The accuracy of the proposed model using LSTM reaches 98.56%, and the precision and recall of the noise class reach 99% and 99.53%, respectively.
Keywords:
web forum
social media
content noise
posting quality
text mining
deep learning
machine learning

Journal

Sustainability cover
Sustainability
IF:
3.3
Papers:
10.7W
Citations:
28.4W

Organization

S
soonchunhyang university
Scholars:
7.3K
Papers: 6.1K
Citations: 2
Cited Papers

Cited Papers

errShare
errSave
The Concept of Sustainability on Social Media: A Social Listening Approach
err2020-03-09
err38
errOAAI
errTeresa Ballestar, Maria; Cuerdo-Mir, Miguel; Teresa Freire-Rubio, Maria
errShare
errSave
errShare
errSave
Deep learning to filter SMS Spam
err2020-01-01
err101
errOAAI
errRoy, Pradeep Kumar; Singh, Jyoti Prakash; Banerjee, Snehasish
errShare
errSave
Social Sustainability: A New Conceptual Framework
err2017-01-05
err519
errOAAI
errEizenberg, Efrat; Jabareen, Yosef
errShare
errSave
Learning document representation via topic-enhanced LSTM model
err2019-06-01
err29
PREAI
errZhang, Wenyue; Li, Yang; Wang, Suge
errShare
errSave
What is social sustainability? A clarification of concepts
err2011-06-01
err659
PREAI
errValiance, Suzanne; Perkins, Harvey C.; Dixon, Jennifer E.
errShare
errSave
The origin of squamates revealed by a Middle Triassic lizard from the Italian Alps
err2018-05-30
err0
PREAI
errTiago R. Simões; Michael W. Caldwell; Mateusz Tałanda; Massimo Bernardi; Alessandro Palci; Oksana Vernygora; Federico Bernardini; Lucia Mancini; Randall L. Nydam
errShare
errSave
researcher View more