.png){kind=icon}
返回
Using meta-learning to predict performance metrics in machine learning problems
.png){kind=icon}
OA
AI
DOI：10.1111/exsy.12900.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Machine learning has been facing significant challenges over the last years, much of which stem from the new characteristics of machine learning problems, such as learning from streaming data or incorporating human feedback into existing datasets and models. In these dynamic scenarios, data change over time and models must adapt. However, new data do not necessarily mean new patterns. The main goal of this paper is to devise a method to predict a model's performance metrics before it is trained, in order to decide whether it is worth it to train it or not. That is, will the model hold significantly better results than the current one? To address this issue, we propose the use of meta-learning. Specifically, we evaluate two different meta-models, one built for a specific machine learning problem, and another built based on many different problems, meant to be a generic meta-model, applicable to virtually any problem. In this paper, we focus only on the prediction of the root mean square error (RMSE). Results show that it is possible to accurately predict the RMSE of future models, event in streaming scenarios. Moreover, results also show that it is possible to reduce the need for re-training models between 60% and 98%, depending on the problem and on the threshold used.
Keyword:
error prediction
interactive machine learning
meta-learning
期刊
IF:
2.3
论文数:
2.6K
被引数:
3.8K
机构
引用论文
Structural development of a major late Cenozoic basin and transpressional belt in central Iran: The Central Basin in the Qom-Saveh area.png)
Geosphere
OAAI
GeosphereIF0
OAAI分享收藏Interactive machine learning: experimental evidence for the human in the algorithmic loop: A case study on Ant Colony Optimization交互式机器学习: 算法循环中人类的实验证据: 蚁群优化的案例研究APPLIED INTELLIGENCEOAAI
APPLIED INTELLIGENCEIF3.5
OAAI分享收藏Simulating LoRaWAN for Flood Early Warning System in Ciliwung River, Bogor-Jakarta模拟Ciliwung河（Bogor-Jakarta）洪水早期预警系统中的LoRaWAN
PREAI
分享收藏ilastik: interactive machine learning for (bio) image analysisilastik: 用于 (生物) 图像分析的交互式机器学习NATURE METHODSOAAI
NATURE METHODSIF32.1
OAAI分享收藏分享收藏IoT Server Availability Considering DDoS-attacks: Analysis of Prevention Methods and Markov Model物联网服务器可用性考虑DDoS攻击：预防方法分析及马尔可夫模型
PREAI
分享收藏Effects of size and size structure on predation and inter-cohort competition in red-eyed treefrog tadpolesOecologia
OecologiaIF0
PREAI
分享收藏
查看更多内容