Optimizing hyperparameters of deep reinforcement learning for autonomous driving based on whale optimization algorithm

doi:10.1371/journal.pone.0252754

Optimizing hyperparameters of deep reinforcement learning for autonomous driving based on whale optimization algorithm

2021-06-10

0

OA

AI

DOI：10.1371/journal.pone.0252754

原文链接

原文求助

摘要

En 中文

Deep Reinforcement Learning (DRL) enables agents to make decisions based on a well-designed reward function that suites a particular environment without any prior knowledge related to a given environment. The adaptation of hyperparameters has a great impact on the overall learning process and the learning processing times. Hyperparameters should be accurately estimated while training DRL algorithms, which is one of the key challenges that we attempt to address. This paper employs a swarm-based optimization algorithm, namely the Whale Optimization Algorithm (WOA), for optimizing the hyperparameters of the Deep Deterministic Policy Gradient (DDPG) algorithm to achieve the optimum control strategy in an autonomous driving control problem. DDPG is capable of handling complex environments, which contain continuous spaces for actions. To evaluate the proposed algorithm, the Open Racing Car Simulator (TORCS), a realistic autonomous driving simulation environment, was chosen to its ease of design and implementation. Using TORCS, the DDPG agent with optimized hyperparameters was compared with a DDPG agent with reference hyperparameters. The experimental results showed that the DDPG’s hyperparameters optimization leads to maximizing the total rewards, along with testing episodes and maintaining a stable driving policy.

Optimizing hyperparameters of deep reinforcement learning for autonomous driving based on whale optimization algorithm

摘要

期刊

机构

引用论文