arrow
返回

A Missing Type-Aware Adaptive Interpolation Framework for Sensor Data

delete2021-01-01
delete0
PRE
AI
陈
陈灵强 (Lingqiang Chen)
G
Guanghui Li *
G
Guangyan Huang
P
Pei Shi
DOI:10.1109/TIM.2021.3089783delete
delete原文链接
delete分享
delete收藏
摘要

摘要

En 中文
Data missing problems often occur on the Internet-of-Things domains. This article proposes a missing type-aware interpolation framework (IMA) for data loss problems in city-wide environmental monitoring systems that contain many scattered stations. To interpolate data as accurately as possible, IMA considers three aspects of information, i.e., spatiotemporal, all attributes of one measurement, and all values and accordingly develop three methods to estimate the missing data. First, we develop an improved multiviewer method, which uses the spatiotemporal correlation of data from neighbor stations to estimate random missing values. Second, we propose a new multi-eXtreme Gradient Boosting (multi-XGBoost) method that uses the values of the co-occurring and correlated correct attributes to predict the value of the missing attribute. Third, we take advantage of matrix factorization to estimate the missing parts if the data of the interpolation matrix are not all missing. To avoid the influence of uncorrelated data, IMA calculates Pearson's correlation coefficient between data of each station and uses those data from its top k highest correlation neighbors to form an interpolation matrix. Furthermore, due to the complexity of missing cases, IMA uses confidence levels in each of the three data prediction methods. For example, if the multiviewer method fails, IMA weights all valid results with confidence levels. We conduct our experiments on two real-world datasets from air quality monitoring stations in Beijing. Both datasets contain numerous missing measurements. Experimental results show that IMA outperforms other counterpart methods in interpolating the missing measurements, in terms of accuracy and effectiveness. Compared with the most related method, IMA improves the interpolation accuracy from 0.818 to 0.849 in a small dataset and from 0.214 to 0.759 in a large one.
Keyword:
Data interpolation
matrix factorization
missing type-aware method
multi-eXtreme Gradient Boosting (multi-XGBoost)
spatiotemporal correlation
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Instrumentation and Measurement 封面图
IEEE Transactions on Instrumentation and Measurement
IF:
5.9
论文数:
2.0W
被引数:
7.2W

机构

D
Deakin University
学者数:
1.1K
论文数: 503
被引数: 1.6W
无锡学院 封面图
无锡学院
学者数:
116
论文数: 60
被引数: 405
江南大学 封面图
江南大学
学者数:
4.5K
论文数: 1.1K
被引数: 2.5W
学者 查看更多机构
引用论文

引用论文

err分享
err收藏
Missing data imputation using fuzzy-rough methods
err2016-09-01
err110
errOAAI
errAmiri, Mehran; Jensen, Richard
err分享
err收藏
err分享
err收藏
err分享
err收藏
err分享
err收藏
Predictive model of pollutant loads discharged by combined sewer overflows
err2018-02-07
err0
errOAAI
errAgnieszka Brzezińska; Grażyna Sakson; Marek Zawilski
err分享
err收藏
学者 查看更多内容