.png){kind=icon}
返回
SDEC: Semantic Deep Embedded Clustering
.png){kind=icon}
PRE
AI
DOI：10.1109/TBDATA.2025.3603433.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
The high dimensional and semantically complex nature of textual Big data presents significant challenges for text clustering, which frequently lead to suboptimal groupings when using conventional techniques like k-means or hierarchical clustering. This work presents Semantic Deep Embedded Clustering (SDEC), an unsupervised text clustering framework that combines an improved autoencoder with transformer-based embeddings to overcome these challenges. This novel method preserves semantic relationships during data reconstruction by combining Mean Squared Error (MSE) and Cosine Similarity Loss (CSL) within an autoencoder. Furthermore, a semantic refinement stage that takes advantage of the contextual richness of transformer embeddings is used by SDEC to further improve a clustering layer with soft cluster assignments and distributional loss. The capabilities of SDEC are demonstrated by extensive testing on five benchmark datasets: AG News, Yahoo! Answers, DBPedia, Reuters 2, and Reuters 5. The framework not only outperformed existing methods with a clustering accuracy of 85.7% on AG News and set a new benchmark of 53.63% on Yahoo! Answers, but also showed robust performance across other diverse text corpora. These findings highlight the significant improvements in accuracy and semantic comprehension of text data provided by SDEC's advances in unsupervised text clustering.
Keyword:
Clustering
embeddings
BERT
autoencoder
semantic loss
distributional loss
deep learning
natural language processing (NLP)
fine-tuning
期刊
I
IF:
5.7
论文数:
860
被引数:
3.0K
机构
引用论文
.png){kind=icon}
分享收藏
分享收藏分享收藏A BERT-based Deep Learning Approach for Reputation Analysis in Social Media基于BERT的深度学习方法在社会媒体声誉分析中的应用
OAAI
OAAI分享收藏
查看更多内容