arrow
Return

A Novel Sentence Embedding Based Topic Detection Method for Microblogs

delete2020-01-01
delete4
delete
OA
AI
C
Cong Wan
江山 (Shan Jiang)
C
Cong Wang *
Y
Ying Yuan
王翠荣 (Cuirong Wang)
DOI:10.1109/ACCESS.2020.3036043delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Topic detection is a difficult challenging task, especially when the exact number of topics is unknown. In this article, we present a novel topic detection approach based on neural computing to detect topics in a microblogging dataset. We use an unsupervised neural sentence embedding model to map blogs to an embedding space. The proposed model is a weighted power mean sentence embedding model in which weights are calculated by a targeted attention mechanism. The experimental results show that our embedding model performs better than baseline in sentence clustering. In addition, we propose a clustering algorithm, referred to as Relationship-Aware DBSCAN (RADBSCAN), to discover topics from a microblogging dataset in which the number of topics is automatically determined by the characteristics of the dataset. Moreover, to provide parameter insensibility, we use the forwarding relationship in the blogs as a bridge of two independent clusters. Finally, we validate the proposed method on a dataset from the Sina microblog. The results show that our approach can detect all topics successfully and can extract the keywords of each topic.
Keywords:
Topic detection
attention neural network
sentence clustering
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Access cover
IEEE Access
IF:
3.6
Papers:
9.8W
Citations:
29.4W

Organization

N
northeastern university - china
Scholars:
3.1W
Papers: 2.7W
Citations: 37