arrow
Return

Hybrid Data Lake Entities Localization Optimization Based on Complex Networks

delete2026-01-21
delete0
delete
OA
AI
E
Eduardo Marreto Mendes
J
Jorge Rady de Almeida
DOI:10.1109/ACCESS.2026.3656719delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Data Lakes are a relevant analytics architecture, with current implementations in hybrid and multi-cloud environments presenting governance challenges in cost management and data localization. This work proposes the “Entity Migration Recommender System,” an engine that ingests Data Lake metadata to create optimized complex network digraphs with recommended entity localities. The tool demonstrated a 16.2% overall cost reduction by optimizing data entity placement across cloud and on-premise infrastructure. This method leverages complex network metrics to address the critical dimension of data interoperation costs in distributed analytics environments.
Keywords:
Cloud computing
complex networks
data analytics
data lakes

Journal

IEEE Access cover
IEEE Access
IF:
3.6
Papers:
9.8W
Citations:
29.4W

Organization

U
universidade de sao paulo
Scholars:
10.5W
Papers: 6.7W
Citations: 93