arrow
返回

Reusing ML Models in Dynamic Data Environments: Data Similarity-Based Approach for Efficient MLOps

delete2025-02-19
delete0
delete
OA
AI
E
Eduardo Peixoto
T
Torres, Diogo
D
Davide Carneiro *
B
Bruno Silva
R
Ruben Marques
DOI:10.3390/bdcc9020047delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
The rapid integration of Machine Learning (ML) in organizational practices has driven demand for substantial computational resources, incurring both high economic costs and environmental impact, particularly from energy consumption. This challenge is amplified in dynamic data environments, where ML models must be frequently retrained to adapt to evolving data patterns. To address this, more sustainable Machine Learning Operations (MLOps) pipelines are needed for reducing environmental impacts while maintaining model accuracy. In this paper, we propose a model reuse approach based on data similarity metrics, which allows organizations to leverage previously trained models where applicable. We introduce a tailored set of meta-features to characterize data windows, enabling efficient similarity assessment between historical and new data. The effectiveness of the proposed method is validated across multiple ML tasks using the cosine and Bray-Curtis distance functions, which evaluate both model reuse rates and the performance of reused models relative to newly trained alternatives. The results indicate that the proposed approach can reduce the frequency of model retraining by up to 70% to 90% while maintaining or even improving predictive performance, contributing to more resource-efficient and sustainable MLOps practices.
Keyword:
MLOps
frugal AI
machine learning
meta-learning

期刊

B
Big Data and Cognitive Computing
IF:
4.4
论文数:
1.3K
被引数:
2.4K

机构

I
instituto politecnico do porto
学者数:
2.8K
论文数: 2.7K
被引数: 2
I
INESC TEC
学者数:
1.5K
论文数: 1.4K
被引数: 1.7K
引用论文

引用论文

Carbonyl-isocyanide mono-substitution in [Fe2Cp2(CO)4]: A re-visitation
err2021-03-01
err0
errOAAI
errLorenzo Biancalana; Gianluca Ciancaleoni; Stefano Zacchini; Guido Pampaloni; Fabio Marchetti
err分享
err收藏
Adaptive random forests for evolving data stream classification
err2017-06-13
err483
errOAAI
errGomes, Heitor M.; Bifet, Albert; Read, Jesse; Barddal, Jean Paul; Enembreck, Fabricio; Pfharinger, Bernhard; Holmes, Geoff; Abdessalem, Talel
err分享
err收藏
err分享
err收藏
A review of green artificial intelligence: Towards a more sustainable future绿色人工智能: 迈向更可持续的未来
err2024-09-01
err18
errOAAI
errBolon-Canedo, Veronica; Moran-Fernandez, Laura; Cancela, Brais; Alonso-Betanzos, Amparo
err分享
err收藏
学者 查看更多内容