arrow
返回

Bayesian Reinforcement Learning and Bayesian Deep Learning for Blockchains With Mobile Edge Computing

delete2021-03-01
delete22
PRE
AI
A
Alia Asheralieva *
D
Dusit Niyato
DOI:10.1109/TCCN.2020.2994366delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
We present a novel game-theoretic, Bayesian reinforce-ment learning (RL) and deep learning (DL) framework to represent interactions of miners in public and consortium blockchains with mobile edge computing (MEC). Within the framework, we formulate a stochastic game played by miners under incomplete information. Each miner can offload its block operations to one of the base stations (BSs) equipped with the MEC server. The miners select their offloading BSs and block processing rates simultaneously and independently, without informing other miners about their actions. As such, no miner knows the past and current actions of others and, hence, constructs its belief about these actions. Accordingly, we devise a Bayesian RL algorithm based on the partially-observable Markov decision process for miner's decision making that allows each miner to dynamically adjust its strategy and update its beliefs through repeated interactions with each other and with the mobile environment. We also propose a novel unsupervised Bayesian deep learning algorithm where the uncertainties about unobservable states are approximated with Bayesian neural networks. We show that the proposed Bayesian RL and DL algorithms converge to the stable states where the miners' actions and beliefs form the perfect Bayesian equilibrium (PBE) and myopic PBE, respectively.
Keyword:
Task analysis
Bayes methods
Games
Resource management
Machine learning
Protocols
Bayesian methods
blockchains
deep learning
game theory
incomplete information
machine learning
mobile edge computing
partially-observable Markov decision process
reinforcement learning
resource management
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

I
IEEE Transactions on Cognitive Communications and Networking
IF:
7
论文数:
1.6K
被引数:
5.5K

机构

N
Nanyang Technological University
学者数:
4.9W
论文数: 4.8W
被引数: 8.1W
引用论文

引用论文

Computation Offloading and Content Caching n Wireless Blockchain Networks With Mobile Edge Computing
err2018-11-01
err229
PREAI
errLiu, Mengting; Yu, F. Richard; Teng, Yinglei; Leung, Victor C. M.; Song, Mei
err分享
err收藏
err分享
err收藏
学者 查看更多内容