arrow
返回

Deep-Reinforcement-Learning-Based AoI-Aware Resource Allocation for RIS-Aided IoV Networks

delete2025-01-01
delete5
PRE
AI
K
Kangwei Qi
Q
Qiong Wu *
P
Pingyi Fan
N
Nan Cheng
陈伟 封面图
陈伟 (Wen Chen)
J
Jiangzhou Wang
K
Khaled B. Letaief
DOI:10.1109/TVT.2024.3452790delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Reconfigurable intelligent surface (RIS) is a pivotal technology in communication, offering an alternative path that significantly enhances the link quality in wireless communication environments. In this paper, we propose a RIS-assisted internet of vehicles (IoV) network and consider the vehicle-to-everything (V2X) communication method. In order to improve the timeliness of vehicle-to-infrastructure (V2I) links and the stability of vehicle-to-vehicle (V2V) links, we introduce the age of information (AoI) and the payload transmission probability models. Thus, we aim to minimize the AoI of V2I links and prioritize transmission of V2V links payload. In this framework, the base station (BS) server acts as the agent responsible for resource allocation for vehicles and controlling the phase-shift of the RIS. We use the Soft Actor-Critic (SAC) algorithm to address this problem due to its gradual convergence and high stability in the optimization process. An AoI-aware joint vehicular resource allocation and RIS phase-shift control scheme based on SAC algorithm is proposed and simulation results show that its convergence speed, cumulative reward, AoI performance, and payload transmission probability outperform those of proximal policy optimization (PPO), deep deterministic policy gradient (DDPG), twin delayed deep deterministic policy gradient (TD3) and stochastic algorithms.
Keyword:
Resource management
Reliability
Vehicular ad hoc networks
Heuristic algorithms
Vehicle-to-infrastructure
Optimization
Power control
Reconfigurable intelligent surface (RIS)
internet of vehicles (IoV)
vehicle-to-everything (V2X)
resource allocation
age of information (AoI)
deep reinforcement learning (DRL)

期刊

IEEE Transactions on Vehicular Technology 封面图
IEEE Transactions on Vehicular Technology
IF:
7.1
论文数:
1.8W
被引数:
6.6W

机构

T
tsinghua university
学者数:
11.9W
论文数: 10.0W
被引数: 137
S
shanghai jiao tong university
学者数:
15.7W
论文数: 11.7W
被引数: 159
J
Jiangnan University
学者数:
3.9W
论文数: 2.7W
被引数: 4.7W
U
University of Kent
学者数:
5.3K
论文数: 6.1K
被引数: 8.1K
X
Xidian University
学者数:
2.4W
论文数: 1.9W
被引数: 9.7K
学者 查看更多机构
引用论文

引用论文

Decentralized Power Allocation for MIMO-NOMA Vehicular Edge Computing Based on Deep Reinforcement Learning
err2022-07-15
err85
errOAAI
errZhu, Hongbiao; Wu, Qiong; Wu, Xiao-Jun; Fan, Qiang; Fan, Pingyi; Wang, Jiangzhou
err分享
err收藏
Characterizing Internet Card User Portraits for Efficient Churn Prediction Model Design
err2024-02-01
err10
PREAI
errWu, Fan; Lyu, Feng; Ren, Ju; Yang, Peng; Qian, Kai; Gao, Shijie; Zhang, Yaoxue
err分享
err收藏
Generative AI-Enabled Vehicular Networks: Fundamentals, Framework, and Case Study生成式AI支持的车辆网络: 基础、框架和案例研究
err2024-07-01
err2
errOAAI
errZhang, Ruichen; Xiong, Ke; Du, Hongyang; Niyato, Dusit; Kang, Jiawen; Shen, Xuemin; Poor, H. Vincent
err分享
err收藏
EdgeCooper: Network-Aware Cooperative LiDAR Perception for Enhanced Vehicular Awareness
err2024-01-01
err29
errOAAI
errLuo, Guiyang; Shao, Chongzhang; Cheng, Nan; Zhou, Haibo; Zhang, Hui; Yuan, Quan; Li, Jinglin
err分享
err收藏
AoI-Aware Resource Allocation for Platoon-Based C-V2X Networks via Multi-Agent Multi-Task Reinforcement Learning
err2023-08-01
err37
errOAAI
errParvini, Mohammad; Javan, Mohammad Reza; Mokari, Nader; Abbasi, Bijan; Jorswieck, Eduard A.
err分享
err收藏
学者 查看更多内容