arrow
Return

Mining Data Wrangling Workflows for Design Patterns Discovery and Specification

delete2024-02-01
delete0
delete
OA
AI
A
Abdullah Khalid A. Almasaud
S
Sandra Sampaio *
P
Pedro Sampaio
DOI:10.1007/s10796-023-10458-7delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In this paper, we investigate Data Wrangling (DW) pipelines in the form of workflows devised by data analysts with varying levels of experience to find commonalities or patterns. We propose an approach for pattern discovery based on workflow mining techniques, addressing key challenges associated with finding patterns in data preparation solutions. The findings provide insights into the most commonly used DW operations, solution patterns, redundancies, and reuse opportunities in data preparation. The findings were used to create design pattern specifications curated into a catalog in the form of a DW Design Patterns Handbook. The evaluation of the proposed handbook is performed by surveying professionals with results confirming the usefulness of discovered patterns to the construction of DW solutions and assisting data analysts/scientists via the reuse of patterns and best practices in DW.
Keywords:
Data preparation
Workflow mining
Design patterns
Pattern specification
Reusability

Journal

Information Systems Frontiers cover
Information Systems Frontiers
IF:
8.3
Papers:
2.0K
Citations:
6.5K

Organization

U
University of Manchester
Scholars:
5.7W
Papers: 5.3W
Citations: 7.4W
Cited Papers

Cited Papers

Immunosuppression prevents neuronal atrophy in lupus-prone mice:
err2000-11-01
err0
PREAI
errBoris Sakic; Bryan Kolb; Ian Q. Whishaw; Grazyna Gorny; Henry Szechtman; Judah A. Denburg
errShare
errSave
Can language models automate data wrangling?
err2022-12-01
err8
errOAAI
errJaimovitch-Lopez, Gonzalo; Ferri, Cesar; Hernandez-Orallo, Jose; Martinez-Plumed, Fernando; Ramirez-Quintana, Maria Jose
errShare
errSave
Measurement of Mechanical Forces Generated by Skin Fibroblasts Embedded in a Three-Dimensional Collagen Gel
err1991-11-01
err0
PREAI
errPierre. Delvoye; Philippe. Wiliquet; Jean-Luc. Levêque; Betty V. Nusgens; Charles M. Lapière
errShare
errSave
Changes in striatal dopamine D2 receptor binding in pre‐clinical Huntington’s disease
err2009-01-14
err0
PREAI
errJ.C.H. Van Oostrom; M. Dekker; A.T.M. Willemsen; B.M. De Jong; R.A.C. Roos; K.L. Leenders
errShare
errSave
Same-Sex and Race-Based Disparities in Statutory Rape Arrests
err2014-11-20
err0
PREAI
errMark Chaffin; Stephanie Chenoweth; Elizabeth J. Letourneau
errShare
errSave
err
IF0
err
err0
PREAI
err
errShare
errSave
researcher View more