arrow
返回

Modular Data Analytics

delete2024-09-01
delete0
PRE
AI
D
Diomidis Spinellis *
DOI:10.1109/MS.2024.3409988delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Relational online analytical processing (ROLAP) often involves complex queries with many intermediate steps, which can be expensive to run on large datasets. Modularizing SQL queries improves readability, testability, and incremental execution. While SQL common table expressions (CTEs) and views help in modularization, they have availability, performance, or development limitations. To address these, simple-rolap, an open-source framework, automates dependency analysis and orchestrates the execution of modular queries using GNU make. It uses a main database containing the infrequently modified base data and a secondary database for caching intermediate results. Simple-rolap ensures efficient, maintainable ROLAP queries by splitting complex queries into simple ones that create intermediate tables or report results, which can be unit-tested. It uses the make tool to manage dependencies and execution order, enhancing workflow control, testing, visualization, and troubleshooting.

期刊

IEEE Software 封面图
IEEE Software
IF:
3
论文数:
3.2K
被引数:
3.6K

机构

暂无机构信息
引用论文

引用论文

Unit Tests for SQLSQL的单元测试
err2024-01-01
err2
errOAAI
errSpinellis, Diomidis
err分享
err收藏