arrow
Return

Polyglot Persistence in Heterogeneous NoSQL Database Systems with Python

delete2026-01-01
delete0
PRE
AI
D
Diana Martínez-Mosquera *
R
Rosa Navarrete
L
Lorena Recalde
A
Andres Andrade-Cabrera
DOI:10.1007/978-3-031-98287-3_28delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Modern applications often require functionalities that single types of database systems cannot adequately fulfil, prompting the use of multiple types of databases for effective data management. Polyglot persistence enables the integration of various data storage technologies within a single application, leveraging the strengths of each system. This approach, however, introduces complexities in design and implementation, increasing programming complexity and necessitating knowledge of multiple languages. This article presents a practical method for achieving application-coordinated polyglot persistence across key-value, column-oriented, and document-oriented NoSQL databases, specifically focusing on Redis, Cassandra, and MongoDB, using Python. Our proposed three-layer architecture enhances data management and analytics by utilizing Jupyter Notebooks for interactive applications and employing Python libraries for orchestration, integrating specialized NoSQL databases. We encountered specific challenges, such as memory overload in Cassandra during complex query operations, which highlights the limitations in scalability under certain conditions. Additionally, our findings indicate significant variations in query execution times, with MongoDB demonstrating the fastest responses and Cassandra showing delays when handling complex queries. Using the SSB from TPC-H with a dataset of 6,000,000 entries, we evaluated loading times and query execution performance. This study aims to serve as a comprehensive guide for researchers and industry professionals seeking to implement a unified interface across heterogeneous NoSQL engines, providing insights into both the potentials and hurdles of polyglot persistence.
Keywords:
databases
heterogeneous
NoSQL
polyglot persistence
python
SSB dataset evaluation
NoSQL database performance
polyglot database systems

Journal

S
SMART TECHNOLOGIES, SYSTEMS AND APPLICATIONS, SMARTTECH-IC 2024, PT I
IF:
0
Papers:
32
Citations:
0

Organization

E
escuela politecnica nacional ecuador
Scholars:
928
Papers: 945
Citations: 1
Cited Papers

Cited Papers

errShare
errSave
NoSQL, NewSQL, and Polystores
err2019-12-03
err0
PREAI
errM. Tamer Özsu; Patrick Valduriez
errShare
errSave
Ensuring Data Consistency
err2019-01-01
err0
PREAI
errMeier,Andreas; Kaufmann,Michael
errShare
errSave
err
IF0
err
err0
PREAI
err
errShare
errSave
Integrating OLAP with NoSQL Databases in Big Data Environments: Systematic Mapping
err2024-06-05
err1
errOAAI
errMartinez-Mosquera, Diana; Navarrete, Rosa; Lujan-Mora, Sergio; Recalde, Lorena; Andrade-Cabrera, Andres
errShare
errSave
A Review of Polyglot Persistence in the Big Data World
err2019-04-16
err0
errOAAI
errPwint Phyu Khine; Zhaoshun Wang
errShare
errSave
researcher View more