arrow
返回

Embedding a state space model into a Markov decision process

delete2010-02-04
delete15
PRE
AI
L
Lars Relund Nielsen *
E
Erik Jørgensen
S
Søren Højsgaard
DOI:10.1007/s10479-010-0688-zdelete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
In agriculture Markov decision processes (MDPs) with finite state and action space are often used to model sequential decision making over time. For instance, states in the process represent possible levels of traits of the animal and transition probabilities are based on biological models estimated from data collected from the animal or herd. State space models (SSMs) are a general tool for modeling repeated measurements over time where the model parameters can evolve dynamically. In this paper we consider methods for embedding an SSM into an MDP with finite state and action space. Different ways of discretizing an SSM are discussed and methods for reducing the state space of the MDP are presented. An example from dairy production is given.
Keyword:
State space model
Markov decision process
Sequential decision making
Stochastic dynamic programming

期刊

Annals of Operations Research 封面图
Annals of Operations Research
IF:
4.5
论文数:
8.0K
被引数:
2.1W

机构

A
Aarhus University
学者数:
4.3W
论文数: 4.2W
被引数: 4.8W
引用论文

引用论文

Magnetic Resonance Imaging and Micro-Computed Tomography reveal brain morphological abnormalities in a mouse model of early moderate prenatal ethanol exposure
err2020-01-01
err0
PREAI
errVan T. Nguyen; Quang M. Tieng; Karine Mardon; Christine Zhang; Suyinn Chong; Graham J. Galloway; Nyoman D. Kurniawan
err分享
err收藏
err分享
err收藏
学者 查看更多内容