arrow
返回

Recovering Markov models from closed-loop data

delete2019-05-01
delete8
delete
OA
AI
J
Jonathan P. Epperlein *
S
Sergiy Zhuk
R
Robert Shorten
DOI:10.1016/j.automatica.2019.01.022delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Situations in which recommender systems are used to augment decision making are becoming prevalent in many application domains. Almost always, these prediction tools (recommenders) are created with a view to affecting behavioural change. Clearly, successful applications actuating behavioural change, affect the original model underpinning the predictor, leading to an inconsistency. This feedback loop is often not considered in standard machine learning techniques which rely upon machine learning/statistical learning machinery. The objective of this paper is to develop tools that recover unbiased user models in the presence of recommenders. More specifically, we assume that we observe a time series which is a trajectory of a Markov chain R modulated by another Markov chain S, i.e. the transition matrix of R is unknown and depends on the current state of S. The transition matrix of the latter is also unknown. In other words, at each time instant, S selects a transition matrix for R within a given set which consists of known and unknown matrices. The state of S, in turn, depends on the current state of R thus introducing a feedback loop. We propose an Expectation-Maximisation (EM) type algorithm, which estimates the transition matrices of S and R. Experimental results are given to demonstrate the efficacy of the approach. (C) 2019 Elsevier Ltd. All rights reserved.
Keyword:
IDENTIFICATION
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Automatica 封面图
Automatica
IF:
5.9
论文数:
1.2W
被引数:
5.2W

机构

U
university college dublin
学者数:
2.6W
论文数: 2.2W
被引数: 22
引用论文

引用论文

Delineation of probable asperities on the Atotsugawa fault, central Japan, using a dense temporary seismic network
err2007-05-15
err0
PREAI
errAitaro Kato; Takashi Iidaka; Eiji Kurashimo; Shigeki Nakagawa; Naoshi Hirata; Takaya Iwasaki
err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
err分享
err收藏
Decomposition of dioxiranes induced by dialkyl ethers
err1994-05-01
err0
PREAI
errMarta Ferrer; Francisco Sánchez-Baeza; Josefina Casas; Angel Messeguer
err分享
err收藏
Channel equalization for communication with chaotic signals
err1996-01-01
err0
PREAI
errAlan V. Oppenheim; Kevin M. Cuomo; Richard J. Barron; Alan E. Freedman
err分享
err收藏
The Parable of Google Flu: Traps in Big Data Analysis
errSCIENCE
IF45.8
err2014-03-14
err1.6K
PREAI
errLazer, David; Kennedy, Ryan; King, Gary; Vespignani, Alessandro
err分享
err收藏
err分享
err收藏
Raman study on the Ni/SiC interface reaction
err2002-06-15
err0
PREAI
errE. Kurimoto; H. Harima; T. Toda; M. Sawada; M. Iwami; S. Nakashima
err分享
err收藏
学者 查看更多内容