arrow
返回

Optimizing regression models for data streams with missing values

delete2014-07-04
delete16
delete
OA
AI
I
Indrė Žliobaitė *
J
Jaakko Hollmén
DOI:10.1007/s10994-014-5450-3delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Automated data acquisition systems, such as wireless sensor networks, surveillance systems, or any system that records data in operating logs, are becoming increasingly common, and provide opportunities for making decision on data in real or nearly real time. In these systems, data is generated continuously resulting in a stream of data, and predictive models need to be built and updated online with the incoming data. In addition, the predictive models need to be able to output predictions continuously, and without delays. Automated data acquisition systems are prone to occasional failures. As a result, missing values may often occur. Nevertheless, predictions need to be made continuously. Hence, predictive models need to have mechanisms for dealing with missing data in such a way that the loss in accuracy due to occasionally missing values would be minimal. In this paper, we theoretically analyze effects of missing values to the accuracy of linear predictive models. We derive the optimal least squares solution that minimizes the expected mean squared error given an expected rate of missing values. Based on this theoretically optimal solution we propose a recursive algorithm for producing and updating linear regression online, without accessing historical data. Our experimental evaluation on eight benchmark datasets and a case study in environmental monitoring with streaming data validate the theoretical results and confirm the effectiveness of the proposed strategy.
Keyword:
Data streams
Missing data
Linear models
Online regression
Regularized recursive regression
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Machine Learning 封面图
Machine Learning
IF:
2.9
论文数:
2.7K
被引数:
3.4W

机构

A
Aalto University
学者数:
1.6W
论文数: 1.5W
被引数: 2.1W
引用论文

引用论文

Learn++.MF: A random subspace approach for the missing feature problem
err2010-11-01
err64
PREAI
errPolikar, Robi; DePasquale, Joseph; Mohammed, Hussein Syed; Brown, Gavin; Kuncheva, Ludmilla I.
err分享
err收藏
Enzyme Immobilization in Nanoparticles Produced by Inverse Microemulsion Polymerization
err1994-11-01
err0
PREAI
errCatherine Daubresse; Christian Grandfils; Robert Jerome; Philippe Teyssie
err分享
err收藏
A Survey on Concept Drift Adaptation概念漂移适应研究综述
err2014-03-01
err2.0K
errOAAI
errGama, Joao; Zliobaite, Indre; Bifet, Albert; Pechenizkiy, Mykola; Bouchachia, Abdelhamid
err分享
err收藏
Diabetic Neuropathy and Gait: A Review
err2017-09-01
err0
errOAAI
errUazman Alam; David R. Riley; Ravinder S. Jugdey; Shazli Azmi; Satyan Rajbhandari; Kristiaan D’Août; Rayaz A. Malik
err分享
err收藏
Real-Time Analysis of a Modified State Observer for Sensorless Induction Motor Drive Used in Electric Vehicle Applications
err2017-07-25
err0
errOAAI
errMohan Krishna S.; Febin Daya J.L.; Sanjeevikumar Padmanaban; Lucian Mihet-Popa
err分享
err收藏
学者 查看更多内容