arrow
返回

A Blockchain-Enabled Demand Management and Control Framework Driven by Deep Reinforcement Learning

delete2023-01-01
delete12
PRE
AI
R
Rui Ma
Z
Zhehan Yi *
Y
Yingmeng Xiang
D
Di Shi
C
Chunlei Xu
H
Haiwei Wu
DOI:10.1109/TIE.2022.3146631delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
The rapid development of Internet-of-Things in smart grid has enabled millions of grid-connected distributed controllable resources (DCR; e.g., electric vehicles, controllable loads) to provide service to the grid, such as frequency regulation and demand response. The integration of these DCRs may become a large virtual power plant network with various characteristics. This poses great challenges from both control and management perspectives, e.g., computation/communication burden, optimization complexity, scalability limitation, prosumer privacy, etc. In this article, we propose an effective autonomous incentive-based DCR control and management framework to integrate a large amount of DCRs to provide grid services, which simultaneously provides accurate active power adjustment to the grid, optimizes DCR allocations, and maximizes the profits for all prosumers and system operators. A model-free deep deterministic policy gradient-based method is designed to find the optimal incentives in a continuous action space to encourage prosumers to adjust their power consumptions. The method is implemented in a consortium open-source blockchain platform, Hyperledger Fabric, which facilitates controls and transaction management. To demonstrate the effectiveness of the framework, extensive experimental studies are conducted using real-world data.
Keyword:
Blockchains
Resource management
Costs
Batteries
Fabrics
Distributed ledger
Reliability
Blockchain
deep reinforcement learning
energy storage
renewable energy
virtual power plant

期刊

IEEE Transactions on Industrial Electronics 封面图
IEEE Transactions on Industrial Electronics
IF:
7.2
论文数:
1.8W
被引数:
9.8W

机构

S
State Grid Corporation of China
学者数:
6.5K
论文数: 5.2K
被引数: 1.7K
University of Wisconsin System 封面图
University of Wisconsin System
学者数:
6.7W
论文数: 5.8W
被引数: 382
G
George Washington University
学者数:
1.6W
论文数: 1.4W
被引数: 1.7W
U
University of Wisconsin Milwaukee
学者数:
3.9K
论文数: 3.0K
被引数: 6.9K
S
Syracuse University
学者数:
5.4K
论文数: 5.2K
被引数: 8.3K
学者 查看更多机构
引用论文

引用论文

Model-Free Real-Time EV Charging Scheduling Based on Deep Reinforcement Learning
err2019-09-01
err268
PREAI
errWan, Zhiqiang; Li, Hepeng; He, Haibo; Prokhorov, Danil
err分享
err收藏
Association of salivary calcium, phosphate, pH and flow rate on oral health: A study on 90 subjects
err2013-01-01
err0
errOAAI
errMohamed Fiyaz; Amitha Ramesh; Karthikeyan Ramalingam; Biju Thomas; Sucheta Shetty; Prashanth Prakash
err分享
err收藏
On-Line Building Energy Optimization Using Deep Reinforcement Learning基于深度强化学习的在线建筑能耗优化
err2019-07-01
err126
errOAAI
errMocanu, Elena; Mocanu, Decebal Constantin; Nguyen, Phuong H.; Liotta, Antonio; Webber, Michael E.; Gibescu, Madeleine; Slootweg, J. G.
err分享
err收藏
Deep-Reinforcement-Learning-Based Autonomous Voltage Control for Power Grid Operations
err2020-01-01
err281
PREAI
errDuan, Jiajun; Shi, Di; Diao, Ruisheng; Li, Haifeng; Wang, Zhiwei; Zhang, Bei; Bian, Desong; Yi, Zhehan
err分享
err收藏
A Multi-Agent Reinforcement Learning-Based Data-Driven Method for Home Energy Management
err2020-07-01
err248
errOAAI
errXu, Xu; Jia, Youwei; Xu, Yan; Xu, Zhao; Chai, Songjian; Lai, Chun Sing
err分享
err收藏
Local Energy Markets: Paving the Path Toward Fully Transactive Energy Systems
err2019-09-01
err216
errOAAI
errLezama, Fernando; Soares, Joao; Hernandez-Leal, Pablo; Kaisers, Michael; Pinto, Tiago; Vale, Zita
err分享
err收藏
学者 查看更多内容