arrow
返回

A Drift-Sensitive Distributed LSTM Method for Short Text Stream Classification

delete2023-02-01
delete8
PRE
AI
李培培 封面图
李培培 (Peipei Li) *
Y
Yingying Liu
Y
Yang Hu
Y
Yuhong Zhang
X
Xuegang Hu
K
Kui Yu
DOI:10.1109/TBDATA.2022.3164239delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Real-world applications especially in the fields of social media have produced massive short text streams. Unlike traditional normal texts, these data present the characteristics of short length, high-volume, high-velocity and variable data distribution etc, which lead to the issues of data sparsity and concept drift. It is hence very challenging for existing short text classification algorithms. Therefore, we propose a flexible Long Short-Term Memory (LSTM) ensemble network based short text stream classification approach, which is implemented in a distributed mode while maintaining the high-accuracy advantage of deep learning models. More specifically, external resource based short text embedding using a pretrained embedding model and CNN is first proposed for the solution to the data sparsity of short texts. Second, to adapt to the high-volume and high-velocity short text streams, a flexible LSTM network is developed and implemented in a distributed mode for classifying short text data streams. Third, a concept drift factor is introduced for adapting to the concept drifts caused by the changing of data distributions. Finally, experiments conducted on three real short text data sets demonstrate that as compared with several state-of-the-art short text (stream) classification approaches, the proposed approach can classify short text streams effectively and efficiently while adapting to concept drifts.
Keyword:
Adaptation models
Semantics
Data models
Deep learning
Taxonomy
Convolutional neural networks
Big Data
Short text stream
classification
deep learning model
concept drift

期刊

I
IEEE Transactions on Big Data
IF:
5.7
论文数:
892
被引数:
3.0K

机构

H
hefei university of technology
学者数:
2.5W
论文数: 1.7W
被引数: 35
T
Tencent
学者数:
1.1K
论文数: 898
被引数: 5
引用论文

引用论文

Comparative study of sultamicilln and amoxicillin-clavulanate
err1993-01-01
err0
PREAI
errKENNY H. CHAN; CHARLES D. BLUESTONE; LING SHI TAN; KIETH S. REISINGER; MARK M. BLATTER; PATRICIA A. FALL
err分享
err收藏
Cytotoxicity of flavonoids on cancer cell lines. Structure-activity relationship
err2002-01-01
err0
PREAI
errM. López-Lázaro; M. Gálvez; C. Martín-Cordero; M.J. Ayuso
err分享
err收藏
Targeting the forkhead box protein P1 pathway as a novel therapeutic approach for cardiovascular diseases
err2020-07-09
err0
PREAI
errXin-Ming Liu; Sheng-Li Du; Ran Miao; Le-Feng Wang; Jiu-Chang Zhong
err分享
err收藏
On evaluating stream learning algorithms
err2012-10-24
err360
errOAAI
errGama, Joao; Sebastiao, Raquel; Rodrigues, Pedro Pereira
err分享
err收藏
err分享
err收藏
学者 查看更多内容