arrow
返回

Deep Inverse Reinforcement Learning for Objective Function Identification in Bidding Models

delete2021-11-01
delete25
PRE
AI
郭
郭鸿业 (Hongye Guo)
陈
陈启鑫 (Qixin Chen) *
Q
Qing Xia
康重庆 封面图
康重庆 (Chongqing Kang)
DOI:10.1109/TPWRS.2021.3076296delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Due to the deregulation of power systems worldwide, bidding behavior simulation research has gained prominence. One crucial element in these studies is accurately defining and modelling the individual reward function (or objective function). Considering the ubiquitous information barriers between market participants and researchers, the common way is to develop reward functions based on theoretical assumptions, which will inevitably cause deviations from the real world. However, since market data have gradually become transparent in recent years, especially data regarding historical bidding behaviors, it is feasible to introduce data-driven methods to identify the individual reward functions that are hidden in raw bidding data. Thus, this paper proposes a data-driven bidding objective function identification framework with three procedures. First, the bidding decision processes of participants are formulated as a standard Markov decision process. Second, a deep inverse reinforcement learning method that is based on maximum entropy is introduced to identify individual reward functions, whose high-dimensional nonlinearity could be saved in multilayer perceptions (MLPs). Third, a deep Q-network method is customized to simulate the individual bidding behaviors based on the obtained MLP-based objective functions. The effectiveness and feasibility of the proposed framework and methods are tested based on real market data from the Australian electricity market.
Keyword:
Linear programming
Generators
Data models
Reinforcement learning
Decision making
Power markets
Object recognition
Electricity market
individual reward function
data-driven analysis
inverse reinforcement learning
deep reinforcement learning
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Power Systems 封面图
IEEE Transactions on Power Systems
IF:
7.2
论文数:
1.1W
被引数:
5.0W

机构

T
tsinghua university
学者数:
11.9W
论文数: 10.0W
被引数: 137
引用论文

引用论文

Optimal Offering and Operating Strategy for a Large Wind-Storage System as a Price Maker
err2017-11-01
err76
errOAAI
errDing, Huajie; Pinson, Pierre; Hu, Zechun; Wang, Jianhui; Song, Yonghua
err分享
err收藏
Model-Free Real-Time EV Charging Scheduling Based on Deep Reinforcement Learning
err2019-09-01
err268
PREAI
errWan, Zhiqiang; Li, Hepeng; He, Haibo; Prokhorov, Danil
err分享
err收藏
err分享
err收藏
Optimal electricity supply bidding by Markov decision process
err2000-05-01
err188
errOAAI
errSong, HL; Liu, CC; Lawarrée, J; Dahlgren, RW
err分享
err收藏
Evaluation of Market Rules Using a Multi-Agent System Method
err2010-02-01
err78
PREAI
errYu, Nan-Peng; Liu, Chen-Ching; Price, James
err分享
err收藏
On-Line Building Energy Optimization Using Deep Reinforcement Learning基于深度强化学习的在线建筑能耗优化
err2019-07-01
err126
errOAAI
errMocanu, Elena; Mocanu, Decebal Constantin; Nguyen, Phuong H.; Liotta, Antonio; Webber, Michael E.; Gibescu, Madeleine; Slootweg, J. G.
err分享
err收藏
学者 查看更多内容