返回
A Missing Type-Aware Adaptive Interpolation Framework for Sensor Data
DOI:10.1109/TIM.2021.3089783.png)
摘要
En 中文
Data missing problems often occur on the Internet-of-Things domains. This article proposes a missing type-aware interpolation framework (IMA) for data loss problems in city-wide environmental monitoring systems that contain many scattered stations. To interpolate data as accurately as possible, IMA considers three aspects of information, i.e., spatiotemporal, all attributes of one measurement, and all values and accordingly develop three methods to estimate the missing data. First, we develop an improved multiviewer method, which uses the spatiotemporal correlation of data from neighbor stations to estimate random missing values. Second, we propose a new multi-eXtreme Gradient Boosting (multi-XGBoost) method that uses the values of the co-occurring and correlated correct attributes to predict the value of the missing attribute. Third, we take advantage of matrix factorization to estimate the missing parts if the data of the interpolation matrix are not all missing. To avoid the influence of uncorrelated data, IMA calculates Pearson's correlation coefficient between data of each station and uses those data from its top k highest correlation neighbors to form an interpolation matrix. Furthermore, due to the complexity of missing cases, IMA uses confidence levels in each of the three data prediction methods. For example, if the multiviewer method fails, IMA weights all valid results with confidence levels. We conduct our experiments on two real-world datasets from air quality monitoring stations in Beijing. Both datasets contain numerous missing measurements. Experimental results show that IMA outperforms other counterpart methods in interpolating the missing measurements, in terms of accuracy and effectiveness. Compared with the most related method, IMA improves the interpolation accuracy from 0.818 to 0.849 in a small dataset and from 0.214 to 0.759 in a large one.
Keyword:
Data interpolation
matrix factorization
missing type-aware method
multi-eXtreme Gradient Boosting (multi-XGBoost)
spatiotemporal correlation
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
5.9
论文数:
2.0W
被引数:
7.2W
机构
引用论文
Missing data imputation with adversarially-trained graph convolutional networks使用敌方训练的图卷积网络进行缺失数据插补
NEURAL NETWORKS
IF6.3
The Relative Influence of Lesion Length and Other Stenosis Morphologies on Procedural Success of Coronary Intervention病变长度和其他狭窄形态对冠状动脉介入手术成功的相对影响
Angiology
IF0
Application of a multi-stage neural network approach for time-series landfill gas modeling with missing data imputation
WASTE MANAGEMENT
IF7.1
Polymeric membrane fouling in sugarcane juice ultrafiltration: role of juice polysaccharides
Desalination
IF0

