.png){kind=icon}
返回
Method for Selecting a Data Imputation Model Based on Programming by Example for Data Analysts
.png){kind=icon}
PRE
AI
DOI：10.1109/BigData50022.2020.9377818.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Recent years have seen an increase in the use of data acquired by sensors and wearable devices. However, depending on the type of sensor or wearable device, the data may be irregular with missing data, outliers, and different units of measurement. The use of these data as direct input into a machine-learning model would not produce the correct results. Therefore, analysts would be required to pre-process the data before data analysis to obtain accurate results. In particular, sensor data may contain more outliers and missing data because of network congestion and the limited life of sensor batteries than data acquired by other means. To efficiently perform such preprocessing, we previously proposed APREP-S (automatic preprocessing of sensor data) using Bayesian inference based on programming by example. APREP-S defines one model for each imputation method, as the workflow selects models based on the features of the imputation area. Therefore, this APREP-S model must be regenerated when data with a different periodicity are used. In other words, depending on whether the data are affected by the weekday or weekend, weather conditions, seasons, etc., the imputation model would have to be generated to consider these features. In this study, we enhanced the method for selecting the optimal imputation model in APREP-S, allowing multiple models to be defined for each input method. We evaluated APREP-S, which uses two types of data, by the mean squared error of these data: 1) human activity data as short-term periodic data, and 2) temperature and humidity data as long-term periodic data. As a result, we concluded that APREP-S is an efficient imputation method.
Keyword:
pre-processing
sensor data
PBE (programming by example)
Bayesian inference
Internet of Things
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
I
IF:
0
论文数:
3
被引数:
0
机构
暂无机构信息
引用论文
Are We Forgetting About IgA? A Re‐examination of Coronavirus Disease 2019 Convalescent Plasma.png)
Transfusion
OAAI
TransfusionIF0
OAAI分享收藏Data driven prediction models of energy use of appliances in a low-energy house数据驱动的低能耗住宅家电能耗预测模型ENERGY AND BUILDINGS
ENERGY AND BUILDINGSIF7.1
PREAI
分享收藏 没有更多内容
没有更多内容