arrow
Return

Distributed Deep Reinforcement Learning-Based Gradient Quantization for Federated Learning Enabled Vehicle Edge Computing

delete2025-03-01
delete20
delete
OA
AI
C
Cui Zhang
W
Wenjun Zhang
Q
Qiong Wu *
P
Pingyi Fan
Q
Qiang Fan
J
Jiangzhou Wang
K
Khaled B. Letaief
DOI:10.1109/JIOT.2024.3447036delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Federated learning (FL) can protect the privacy of the vehicles in vehicle edge computing (VEC) to a certain extent through sharing the gradients of vehicles' local models instead of the local data. The gradients of vehicles' local models are usually large for the vehicular artificial intelligence (AI) applications, thus transmitting such large gradients would cause large per-round latency. Gradient quantization has been proposed as one effective approach to reduce the per-round latency in FL enabled VEC through compressing gradients and reducing the number of bits, i.e., the quantization level, to transmit gradients. The selection of quantization level and thresholds determines the quantization error (QE), which further affects the model accuracy and training time. To do so, the total training time and QE become two key metrics for the FL enabled VEC. It is critical to jointly optimize the total training time and QE for the FL enabled VEC. However, the time-varying channel condition causes more challenges to solve this problem. In this article, we propose a distributed deep reinforcement learning (DRL)-based quantization level allocation scheme to optimize the long-term reward in terms of the total training time and QE. Extensive simulations identify the optimal weighted factors between the total training time and QE, and demonstrate the feasibility and effectiveness of the proposed scheme.
Keywords:
Quantization (signal)
Training
Data models
Computational modeling
Optimization
Internet of Things
Resource management
Distributed deep reinforcement learning (DRL)
federated learning (FL)
gradient quantization
vehicle edge computing (VEC)

Journal

IEEE Internet of Things Journal cover
IEEE Internet of Things Journal
IF:
8.9
Papers:
1.4W
Citations:
7.8W

Organization

W
Wuxi Institute of Technology
Scholars:
184
Papers: 167
Citations: 808
Q
qualcomm
Scholars:
782
Papers: 646
Citations: 1
T
tsinghua university
Scholars:
11.9W
Papers: 10.0W
Citations: 137
J
Jiangnan University
Scholars:
3.9W
Papers: 2.7W
Citations: 4.7W
U
University of Kent
Scholars:
5.3K
Papers: 6.1K
Citations: 8.1K
researcher View more organizations
Cited Papers

Cited Papers

Decentralized Power Allocation for MIMO-NOMA Vehicular Edge Computing Based on Deep Reinforcement Learning
err2022-07-15
err85
errOAAI
errZhu, Hongbiao; Wu, Qiong; Wu, Xiao-Jun; Fan, Qiang; Fan, Pingyi; Wang, Jiangzhou
errShare
errSave
Scheduling for Cellular Federated Edge Learning With Importance and Channel Awareness
err2020-11-01
err170
errOAAI
errRen, Jinke; He, Yinghui; Wen, Dingzhu; Yu, Guanding; Huang, Kaibin; Guo, Dongning
errShare
errSave
Effect of oral contraception on water‐suppressed proton NMR spectra of plasma
err2005-11-18
err0
PREAI
errPierre G. Carlier; Francis Vaesen; Raymond G. Gilles; Elisabeth A. Fradin; Georges L. Rorive
errShare
errSave
Wetland Loss and Research Orientation
err2012-06-12
err0
errOAAI
errXi Chen; Mark Bain; Patrick J. Sullivan; Ziyan Wang
errShare
errSave
errShare
errSave
Model Pruning Enables Efficient Federated Learning on Edge Devices
err2023-12-01
err160
errOAAI
errJiang, Yuang; Wang, Shiqiang; Valls, Victor; Ko, Bong Jun; Lee, Wei-Han; Leung, Kin K.; Tassiulas, Leandros
errShare
errSave
Efficient Federated Learning Algorithm for Resource Allocation in Wireless IoT Networks
err2021-03-01
err98
errOAAI
errVan-Dinh Nguyen; Sharma, Shree Krishna; Vu, Thang X.; Chatzinotas, Symeon; Ottersten, Bjorn
errShare
errSave
researcher View more