.png){kind=icon}
Return
Data reduction for big data application in IOT
.png){kind=icon}
PRE
AI
DOI：10.1007/s12597-025-01071-0.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
The fast development of the Internet of Things (IoT) has cultivated the creation of large, heterogeneous, and high-dimensional data that have significant challenges in terms of effective storage, transmission, and processing. The traditional data-processing tools do not always work effectively in handling such large data, hence the rise in computational expenses and reduced responsiveness of the system. The paper overcomes the issue of data management in high-dimensional IoT-based big-data setting through the introduction of a hybrid dimensionality-reduction model that combines Principal Component Analysis (PCA) with t-Distributed Stochastic Neighbor Embedding (t-SNE). The structure utilizes linear feature-extraction ability of PCA and nonlinear manifold-learning of t-SNE to obtain better compression of data and inferring necessary structural information of data, thus enabling more scalable and reliable analytics of the IoT systems. The proposed framework was coded in Python and tested on the Kaggle Cats vs. Dogs image dataset, which is a typical example of high-dimensional IoT data. A preprocessing was performed followed by multi-rank dimensionality reduction and classification based on Support Vector Machines to evaluate the performance of the empirical investigation. It has been experimentally shown that a hybrid PCA-t-SNES generates a relative 5 -percent gain in data-reduction efficiency compared to conventional PCA, shrinking the original feature space by down-sampling 145,800 features to 450 dimensions with no significant variation in classification accuracy among varying levels of ranking (Rank-1 to Rank-32). The above results affirm that the introduced hybrid model is useful in reducing redundancy, maximizing computational efficiency, and maintaining the accuracy of the analysis. The study provides a reconfigurable and scalable base of IoT data analytics, and would dominate smart sensing, edge computing, and real-time decision-making systems.
Keywords:
IoT
Big data
PCA
t-SNE
Python
Data reduction
Journal
O
IF:
1.8
Papers:
182
Citations:
1.0K
Organization
Cited Papers
Towards Disaster Resilient Smart Cities: Can Internet of Things and Big Data Analytics Be the Game Changers?.png)
IEEE ACCESS
OAAI
IEEE ACCESSIF3.6
OAAIShareSaveEvaluation of distributed stream processing frameworks for IoT applications in Smart CitiesJOURNAL OF BIG DATAOAAI
JOURNAL OF BIG DATAIF6.4
OAAIShareSaveInnovations in Genomics and Big Data Analytics for Personalized Medicine and Health Care: A Review
OAAI
OAAIShareSaveShareSaveBig data and IoT-based applications in smart environments: A systematic reviewCOMPUTER SCIENCE REVIEWOAAI
COMPUTER SCIENCE REVIEWIF12.7
OAAIShareSave
View more