返回
Centralized and Collaborative RL-Based Resource Allocation in Virtualized Dynamic Fog Computing
DOI:10.1109/JIOT.2023.3283143.png)
摘要
En 中文
Fog computing (FC) emerged as a new paradigm enabling the deployment of new Internet of Things (IoT) applications. Fog infrastructure is composed of heterogeneous nodes characterized by a complex distribution, mobility, and sporadic resource availability. Hence, resource coordination for continuous Quality-of-Service (QoS) satisfaction becomes challenging, and accurate resource tracking is needed for flawless servicing. In this context, we investigate and propose online resource allocation solutions. The main objective is to maximize the number of satisfied users within a predefined latency requirement. Hence, we model the FC environment as a Markov Decision Process, and then, we formulate the optimization problem. Due to the problem's NP-hardness, we leverage the reinforcement learning (RL) tool to develop resource allocation schemes. First, a centralized method where a smart fog controller possesses a global awareness of the FC environment is proposed. Next, a more practical and collaborative solution is presented, where each RL-enabled agent manages a group of fog nodes and their resources in order to satisfy computing requests. Based on real-world mobility data sets, simulation results illustrate the high efficiency of the proposed solutions with a preference for the collaborative approach. The superiority of our proposed solutions over state-of-the-art methods is also illustrated.
Keyword:
Index Terms-Collaborative learning
deep reinforcement learning (RL)
fog computing (FC)
multiagent RL
QMIX
resource allocation
期刊
IF:
8.9
论文数:
1.4W
被引数:
7.8W
机构
引用论文
Contract-Based Computing Resource Management via Deep Reinforcement Learning in Vehicular Fog Computing基于深度强化学习的车载雾计算中基于合同的计算资源管理
IEEE ACCESS
IF3.6
Study of bi-directional buck-boost converter topologies for application in electrical vehicle motor drives应用于电动汽车电机驱动的双向buck-boost变换器拓扑研究

