arrow
Return

LabChain: Enabling reproducible and modular scientific experiments in Python

delete2026-02-01
delete0
delete
OA
AI
M
Manuel Couto *
J
Javier Parapar
D
David E. Losada
DOI:10.1016/j.softx.2026.102543delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Python's flexibility accelerates research prototyping but frequently results in unmaintainable code and duplicated computational effort. The absence of software engineering practices in academic development leads to fragile experiments where even minor modifications require rerunning expensive computations from scratch. LabChain addresses this through a pipeline-and-filter architecture with hash-based caching that automatically identifies and reuses intermediate results. When evaluating multiple classifiers on the same embeddings, the framework computes embeddings once-regardless of how many classifiers are tested. This automatic reuse extends across research teams: if another researcher applies different models to the same preprocessed data, LabChain detects existing results and eliminates redundant computation. Beyond efficiency, the framework's modular structure reduces technical debt that obscures experimental logic. Pipelines serialize to JSON for reproducibility and distributed execution across computational clusters. A mental health detection case study demonstrates dual impact: computational savings exceeding 12 hours per task with reduced CO2 emissions, alongside substantial scientific improvements-performance gains up to 192.3% in some tasks. These improvements emerged from clearer experimental organization that exposed a critical preprocessing bug hidden in the original monolithic implementation. LabChain proves that software engineering discipline amplifies scientific discovery.
Keywords:
Scientific workflows
Pipeline architecture
Hash-based caching
Reproducible research
Software engineering practices
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

SoftwareX cover
SoftwareX
IF:
2.4
Papers:
325
Citations:
7.3K

Organization

U
Universidade da Coruna
Scholars:
6.6K
Papers: 5.7K
Citations: 11
U
Universidade de Santiago de Compostela
Scholars:
1.5W
Papers: 1.3W
Citations: 1.4W