arrow
返回

Intelligent Sensing in Dynamic Environments Using Markov Decision Process

delete2011-01-20
delete8
delete
OA
AI
T
Thrishantha Nanayakkara *
M
Malka N. Halgamuge
P
Prasanna Sridhar
A
Asad M. Madni
DOI:10.3390/s110101229delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
In a network of low-powered wireless sensors, it is essential to capture as many environmental events as possible while still preserving the battery life of the sensor node. This paper focuses on a real-time learning algorithm to extend the lifetime of a sensor node to sense and transmit environmental events. A common method that is generally adopted in ad-hoc sensor networks is to periodically put the sensor nodes to sleep. The purpose of the learning algorithm is to couple the sensor's sleeping behavior to the natural statistics of the environment hence that it can be in optimal harmony with changes in the environment, the sensors can sleep when steady environment and stay awake when turbulent environment. This paper presents theoretical and experimental validation of a reward based learning algorithm that can be implemented on an embedded sensor. The key contribution of the proposed approach is the design and implementation of a reward function that satisfies a trade-off between the above two mutually contradicting objectives, and a linear critic function to approximate the discounted sum of future rewards in order to perform policy learning.
Keyword:
sensor network
Markov decision process
sensing
reward shaping
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Sensors 封面图
Sensors
IF:
3.5
论文数:
7.2W
被引数:
20.9W

机构

U
university of london
学者数:
21.5W
论文数: 19.7W
被引数: 305
M
Microsoft
学者数:
3.0K
论文数: 2.7K
被引数: 7
U
university of melbourne
学者数:
5.7W
论文数: 5.4W
被引数: 69
学者 查看更多机构
引用论文

引用论文

Nutrient Competition: A New Axis of Tumor Immunosuppression
errCell
IF0
err2015-09-01
err0
errOAAI
errMadhusudhanan Sukumar; Rahul Roychoudhuri; Nicholas P. Restifo
err分享
err收藏
err分享
err收藏
A neural substrate of prediction and reward预测和奖励的神经基础
errSCIENCE
IF45.8
err1997-03-14
err7.0K
errOAAI
errSchultz, W; Dayan, P; Montague, PR
err分享
err收藏
Soft Power
err1990-01-01
err0
PREAI
errJoseph S. Nye
err分享
err收藏
Efficacy and safety of methotrexate in articular and cutaneous manifestations of systemic lupus erythematosus
err2011-09-21
err0
errOAAI
errMd. Nazrul ISLAM; Mohsin HOSSAIN; Syed A. HAQ; Mohammad N. ALAM; Peter M. TEN KLOOSTER; Johannes J. RASKER
err分享
err收藏
Methotrexate therapy for severe systemic lupus erythematosus
err2005-12-13
err0
PREAI
errJames R. Davidson; Frank M. Graziano; Ralph J. Rothenberg
err分享
err收藏
Neural economics and the biological substrates of valuation
errNEURON
IF15
err2002-10-01
err777
errOAAI
errMontague, PR; Berns, GS
err分享
err收藏
学者 查看更多内容