返回
Genetic-Algorithm-Aided Deep Reinforcement Learning for Multi-Agent Drone Delivery
DOI:10.3390/drones8030071.png)
摘要
En 中文
The popularity of commercial unmanned aerial vehicles has drawn great attention from the e-commerce industry due to their suitability for last-mile delivery. However, the organization of multiple aerial vehicles efficiently for delivery within limitations and uncertainties is still a problem. The main challenge of planning is scalability, since the planning space grows exponentially to the number of agents, and it is not efficient to let human-level supervisors structure the problem for large-scale settings. Algorithms based on Deep Q-Networks had unprecedented success in solving decision-making problems. Extension of these algorithms to multi-agent problems is limited due to scalability issues. This work proposes an approach that improves the performance of Deep Q-Networks on multi-agent delivery by drone problems by utilizing state decompositions for lowering the problem complexity, Curriculum Learning for handling the exploration complexity, and Genetic Algorithms for searching efficient packet-drone matching across the combinatorial solution space. The performance of the proposed method is shown in a multi-agent delivery by drone problem that has 10 agents and approximate to 1077 state-action pairs. Comparative simulation results are provided to demonstrate the merit of the proposed method. The proposed Genetic-Algorithm-aided multi-agent DRL outperformed the rest in terms of scalability and convergent behavior.
Keyword:
reinforcement learning
genetic algorithms
deep q-networks
delivery by drone
multi-agent decision making
期刊
D
IF:
4.8
论文数:
3.9K
被引数:
8.3K
机构
引用论文
A Novel Method for Improving the Training Efficiency of Deep Multi-Agent Reinforcement Learning一种提高深度多Agent强化学习训练效率的新方法
IEEE ACCESS
IF3.6
Study of bi-directional buck-boost converter topologies for application in electrical vehicle motor drives应用于电动汽车电机驱动的双向buck-boost变换器拓扑研究

