arrow
Return

Optimal Demand Response Using Device-Based Reinforcement Learning

delete2015-09-01
delete204
delete
OA
AI
Z
Zheng Wen *
D
Daniel O’Neill
DOI:10.1109/TSG.2015.2396993delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Demand response (DR) for residential and small commercial buildings is estimated to account for as much as 65% of the total energy savings potential of DR, and previous work shows that a fully automated energy management system (EMS) is a necessary prerequisite to DR in these areas. In this paper, we propose a novel EMS formulation for DR problems in these sectors. Specifically, we formulate a fully automated EMS's rescheduling problem as a reinforcement learning (RL) problem, and argue that this RL problem can be approximately solved by decomposing it over device clusters. Compared with existing formulations, our new formulation does not require explicitly modeling the user's dissatisfaction on job rescheduling, enables the EMS to self-initiate jobs, allows the user to initiate more flexible requests, and has a computational complexity linear in the number of device clusters. We also demonstrate the simulation results of applying Q-learning, one of the most popular and classical RL algorithms, to a representative example.
Keywords:
Building and home automation
demand response (DR)
energy management system (EMS)
Markov decision process (MDP)
reinforcement learning (RL)
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Smart Grid cover
IEEE Transactions on Smart Grid
IF:
9.8
Papers:
5.7K
Citations:
4.3W

Organization

S
samsung
Scholars:
8.6K
Papers: 6.4K
Citations: 8
S
Stanford University
Scholars:
9.6W
Papers: 8.2W
Citations: 17.0W
Y
yahoo! inc
Scholars:
211
Papers: 208
Citations: 0
researcher View more organizations
Cited Papers

Cited Papers

Complementation of T4 phage am mutations by hybrid phages λ-T4
err1980-07-01
err0
PREAI
errD. Vorozheikina; I. Glinskaite; L. Tikhomirova; A. Bayev
errShare
errSave
1-Methyl-2-Pyrrolidone: From Exfoliating Solvent to a Paramagnetic Ligand
err2013-03-06
err0
PREAI
errA. A. Lemus-Santana; M. González; J. Rodríguez-Hernández; M. Knobel; E. Reguera
errShare
errSave
Online learning neural architectures and cross-correlation analysis for actuator failure detection and identification
err2007-10-31
err0
PREAI
errMARCELLO R. NAPOLITANO; VAN CASDORPH; CHARLES NEPPACH; STEVE NAYLOR; MARIO INNOCENTI; GIOVANNI SILVESTRI
errShare
errSave
Low‐cost, green synthesis and adsorption properties for dyes of novel porous gangue/palygorskite composite microspheres
err2019-02-13
err0
PREAI
errShu Yan; Qinggang Wang; Fanyong Zhang; Xiaoyan Zhang; Yuju Lu; Ke Gan; Wenlong Huo; Shuhao Zhang; Jingjing Liu; Jinlong Yang
errShare
errSave
Cloning of bacteriophage T5 DNA fragments in plasmid pBR322 and bacteriophage λ gtwes
errGene
IF0
err1979-12-01
err0
PREAI
errFrancoise Brunel; John Davison; Mireille Merchez
errShare
errSave
researcher View more