arrow
Return

Operationalizing and automating Data Governance

delete2022-12-10
delete3
delete
OA
AI
N
Nadal, Sergi *
P
Petar Jovanović
B
Besim Bilalli
O
Oscar Romero
DOI:10.1186/s40537-022-00673-5delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
The ability to cross data from multiple sources represents a competitive advantage for organizations. Yet, the governance of the data lifecycle, from the data sources into valuable insights, is largely performed in an ad-hoc or manual manner. This is specifically concerning in scenarios where tens or hundreds of continuously evolving data sources produce semi-structured data. To overcome this challenge, we develop a framework for operationalizing and automating data governance. For the first, we propose a zoned data lake architecture and a set of data governance processes that allow the systematic ingestion, transformation and integration of data from heterogeneous sources, in order to make them readily available for business users. For the second, we propose a set of metadata artifacts that allow the automatic execution of data governance processes, addressing a wide range of data management challenges. We showcase the usefulness of the proposed approach using a real world use case, stemming from the collaborative project with the World Health Organization for the management and analysis of data about Neglected Tropical Diseases. Overall, this work contributes on facilitating organizations the adoption of data-driven strategies into a cohesive framework operationalizing and automating data governance.
Keywords:
Data Governance
Data Integration
Big Data
Metadata
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Journal of Big Data cover
Journal of Big Data
IF:
6.4
Papers:
1.4K
Citations:
1.1W

Organization

U
universitat politecnica de catalunya
Scholars:
1.9W
Papers: 1.6W
Citations: 17