返回
Deep-Reinforcement-Learning-Based AoI-Aware Resource Allocation for RIS-Aided IoV Networks
DOI:10.1109/TVT.2024.3452790.png)
摘要
En 中文
Reconfigurable intelligent surface (RIS) is a pivotal technology in communication, offering an alternative path that significantly enhances the link quality in wireless communication environments. In this paper, we propose a RIS-assisted internet of vehicles (IoV) network and consider the vehicle-to-everything (V2X) communication method. In order to improve the timeliness of vehicle-to-infrastructure (V2I) links and the stability of vehicle-to-vehicle (V2V) links, we introduce the age of information (AoI) and the payload transmission probability models. Thus, we aim to minimize the AoI of V2I links and prioritize transmission of V2V links payload. In this framework, the base station (BS) server acts as the agent responsible for resource allocation for vehicles and controlling the phase-shift of the RIS. We use the Soft Actor-Critic (SAC) algorithm to address this problem due to its gradual convergence and high stability in the optimization process. An AoI-aware joint vehicular resource allocation and RIS phase-shift control scheme based on SAC algorithm is proposed and simulation results show that its convergence speed, cumulative reward, AoI performance, and payload transmission probability outperform those of proximal policy optimization (PPO), deep deterministic policy gradient (DDPG), twin delayed deep deterministic policy gradient (TD3) and stochastic algorithms.
Keyword:
Resource management
Reliability
Vehicular ad hoc networks
Heuristic algorithms
Vehicle-to-infrastructure
Optimization
Power control
Reconfigurable intelligent surface (RIS)
internet of vehicles (IoV)
vehicle-to-everything (V2X)
resource allocation
age of information (AoI)
deep reinforcement learning (DRL)
期刊
IF:
7.1
论文数:
1.8W
被引数:
6.6W
机构
引用论文
Knowledge-Driven Deep Learning Paradigms for Wireless Network Optimization in 6G基于知识驱动的深度学习范式在6g无线网络优化中的应用
IEEE NETWORK
IF6.3
Smart Radio Environments Empowered by Reconfigurable Intelligent Surfaces: How It Works, State of Research, and The Road Ahead由可重构智能表面支持的智能无线电环境: 工作原理、研究现状和未来之路
Generative AI-Enabled Vehicular Networks: Fundamentals, Framework, and Case Study生成式AI支持的车辆网络: 基础、框架和案例研究
IEEE NETWORK
IF6.3

