arrow
返回

A comparative dimensionality reduction study in telecom customer segmentation using deep learning and PCA

delete2020-02-03
delete63
delete
OA
AI
M
Maha Alkhayrat *
K
Kadan Aljoumaa
DOI:10.1186/s40537-020-0286-0delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Telecom Companies logs customer's actions which generate a huge amount of data that can bring important findings related to customer's behavior and needs. The main characteristics of such data are the large number of features and the high sparsity that impose challenges to the analytics steps. This paper aims to explore dimensionality reduction on a real telecom dataset and evaluate customers' clustering in reduced and latent space, compared to original space in order to achieve better quality clustering results. The original dataset contains 220 features that belonging to 100,000 customers. However, dimensionality reduction is an important data preprocessing step in the data mining process specially with the presence of curse of dimensionality. In particular, the aim of data reduction techniques is to filter out irrelevant features and noisy data samples. To reduce the high dimensional data, we projected it down to a subspace using well known Principal Component Analysis (PCA) decomposition and a novel approach based on Autoencoder Neural Network, performing in this way dimensionality reduction of original data. Then K-Means Clustering is applied on both-original and reduced data set. Different internal measures were performed to evaluate clustering for different numbers of dimensions and then we evaluated how the reduction method impacts the clustering task.
Keyword:
Autoencoder
PCA
Neural networks
Deep learning
Big data
Clustering
Data representation
Dimentionality reduction
Segmentation
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Journal of Big Data 封面图
Journal of Big Data
IF:
6.4
论文数:
1.5K
被引数:
1.1W

机构

暂无机构信息
引用论文

引用论文

err分享
err收藏
err分享
err收藏
学者 查看更多内容