arrow
Return

Multiobjective Environmental Cleanup with Autonomous Surface Vehicle Fleets Using Multitask Multiagent Deep Reinforcement Learning

delete2025-10-20
delete0
delete
OA
AI
D
Dame Seck Diop *
S
Samuel Yanes Luis
M
Manuel A. Perales‐Esteve
D
Daniel Gutiérrez Reina
S
S. L. Toral
DOI:10.1002/aisy.202500434delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Plastic pollution in water bodies threatens and disrupts aquatic life, requiring effective cleanup solutions. This paper proposes a strategy for plastic cleanup using a fleet of autonomous surface vehicles in a multitask scenario, with a focus on both exploration and cleaning tasks. The mission is decoupled into two phases: an exploration phase for locating trash and a cleaning phase for collection. A Multitask Deep Q-Network with two heads estimates Q-values for each task, and all ASVs share the same policy through an egocentric state formulation to enhance scalability. A multiobjective learning approach is applied, resulting in distinct policies that balance the duration of the exploration and cleaning phases, leading to the construction of a Pareto front, which provides a visual representation of trade-offs between task priorities. The framework adapts to various environmental conditions, demonstrated in both the larger Malaga Port and the smaller Alamillo Lake. The study also highlights the importance of a dedicated exploration phase for larger areas, while minimal exploration is sufficient for smaller spaces. Compared to the decomposition weighting sum strategy, the approach consistently produces superior Pareto-optimal policies, ensuring broader and more effective exploration of the objective space.
Keywords:
autonomous surface vehicles
environmental monitoring
multiobjective optimization
multitask multiagent deep reinforcement learning
partially observable Markov games
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Advanced Intelligent Systems cover
Advanced Intelligent Systems
IF:
6.1
Papers:
2.0K
Citations:
8.4K

Organization

U
University of Sevilla
Scholars:
1.9W
Papers: 1.7W
Citations: 15