arrow
Return

Multi-Objective Reinforcement Learning Algorithm for Irregular Spatial Clusters Detection

delete2026-01-01
delete0
PRE
AI
D
Dênis Oliveira
A
Anderson Ribeiro Duarte
A
André Luiz Carvalho Ottoni
G
Gladston Moreira *
DOI:10.1007/978-3-032-05176-9_32delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Methods for detecting irregular spatial clusters encompass a wide range of practical applications, establishing themselves as valuable tools for analyzing disease outbreaks and other phenomena. However, spatial scan statistics, widely adopted as a methodology in these analyses, require the support of strategies to mitigate the overestimation of candidate clusters. To address this challenge, multi-objective optimization techniques have been introduced, which optimize the scan statistic simultaneously with a penalty function applied to the shape or structure of candidate clusters. We propose an innovative method based on a Multi-Objective Reinforcement Learning (MORL) paradigm with a specialized Multi-Objective Markov Decision Process (MOMDP). Our approach centers on a novel Pareto Q-Learning Scan (PQL-SCAN) algorithm that dynamically learns an efficient policy set. This method generates candidate clusters by optimizing a reward vector defined by two conflicting objectives: maximizing the spatial scan statistic and minimizing the dispersion penalty function. Comprehensive computational experiments were initially conducted on a synthetic dataset map with artificial clusters, followed by evaluations on a real-world disease map. The results demonstrate the high efficiency, robustness, and adaptability of the PQL-SCAN in accurately detecting complex irregular clusters.
Keywords:
Multi-Objective optimization
Reinforcement Learning
Irregular Spatial Cluster Detection

Journal

P
PROGRESS IN ARTIFICIAL INTELLIGENCE, EPIA 2025, PT I
IF:
0
Papers:
38
Citations:
0

Organization

U
Universidade Federal de Ouro Preto
Scholars:
3.2K
Papers: 2.2K
Citations: 1.6K
Cited Papers

Cited Papers

Spatial clustering and contextual factors associated with hospitalisation and deaths due to COVID-19 in Sweden: a geospatial nationwide ecological study
err2021-07-28
err22
errOAAI
errFonseca-Rodriguez, Osvaldo; Gustafsson, Per E.; San Sebastian, Miguel; Connolly, Anne-Marie Fors
errShare
errSave
errShare
errSave
Reinforcement learning for combinatorial optimization: A survey
err2021-10-01
err375
errOAAI
errMazyavkina, Nina; Sviridov, Sergey; Ivanov, Sergei; Burnaev, Evgeny
errShare
errSave
Penalized likelihood and multi-objective spatial scans for the detection and inference of irregular clusters
err2010-10-29
err28
errOAAI
errCancado, Andre L. F.; Duarte, Anderson R.; Duczmal, Luiz H.; Ferreira, Sabino J.; Fonseca, Carlos M.; Gontijo, Eliane C. D. M.
errShare
errSave
Multi-objective approach for multiple clusters detection in data points events
err2019-09-18
err0
PREAI
errEmerson C. Bodevan; Luiz H. Duczmal; Anderson R. Duarte; Pedro H. L. Silva; Gladston J. P. Moreira
errShare
errSave
researcher View more