arrow
Return

A topic modeling framework for spatio-temporal information management

delete2020-11-01
delete19
delete
OA
AI
M
Mohsen Asghari *
D
Daniel Sierra-Sosa
A
Adel Elmaghraby
DOI:10.1016/j.ipm.2020.102340delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Real-time processing and learning of conflicting data, especially messages coming from different ideas, locations, and time, in a dynamic environment such as Twitter is a challenging task that recently gained lots of attention. This paper introduces a framework for managing, processing, analyzing, detecting, and tracking topics in streaming data. We propose a model selector procedure with a hybrid indicator to tackle the challenge of online topic detection. In this framework, we built an automatic data processing pipeline with two levels of cleaning. Regular and deep cleaning are applied using multiple sources of meta knowledge to enhance data quality. Deep learning and transfer learning techniques are used to classify health-related tweets, with high accuracy and improved F1-Score. In this system, we used visualization to have a better understanding of trending topics. To demonstrate the validity of this framework, we implemented and applied it to health-related twitter data from users originating in the USA over nine months. The results of this implementation show that this framework was able to detect and track the topics at a level comparable to manual annotation. To better explain the emerging and changing topics in various locations over time the result is graphically displayed on top of the United States map.
Keywords:
Spatio-temporal real time analysis
Traceability
Topic modeling
Visualization
Artificial intelligent
Transfer learning
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

I
Information Processing and Management
IF:
6.9
Papers:
5.2K
Citations:
1.4W

Organization

U
University of Louisville
Scholars:
1.3W
Papers: 1.0W
Citations: 1.3W