.png){kind=icon}
返回
CF-DAML: Distributed automated machine learning based on collaborative filtering
.png){kind=icon}
PRE
AI
DOI：10.1007/s10489-021-03049-z.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
The search for a good machine learning (ML) model takes a long time and requires the considerations of many alternatives, including data preprocessing, algorithm selection, and hyperparameter tuning methods. Thus, tedious searches face a combinatorial explosion problem. In this work, we build a new automated machine learning (AutoML) system called CF-DAML, a distributed automated system based on collaborative filtering (CF), to address these challenges by recommending and training suitable models for supervised learning tasks. CF-DAML first computes some informative meta-features for a new dataset, then uses a weighted l(1)-norm (W1-norm) to accurately calculate the k nearest neighbors (kNN) of the new dataset, and finally recommends the top N models with good performances on each of its neighbors to the new dataset. We also design a distributed system (DSTM) for training the models to reduce the time complexity substantially. In addition, we develop a multilayer selective stacked ensemble system (MSSE), whose base models are selected from among suitable candidate models based on their runtimes, classification accuracies, and diversities, to enhance the stability of CF-DAML. To our knowledge, this is the first work to combine memory-based CF and the selective stacked ensemble to solve the AutoML problem. Extensive experiments are conducted on many UCI datasets and the comparative results demonstrate that our approach outperforms the current state-of-the-art methods.
Keyword:
Automated machine learning
Collaborative filtering
Weighted l(1)-norm
Distributed automated system
Multilayer selective stacked ensemble
期刊
IF:
3.5
论文数:
7.6K
被引数:
1.7W
机构
引用论文
iLearn: an integrated platform and meta-learner for feature engineering, machine-learning analysis and modeling of DNA, RNA and protein sequence dataiLearn: 用于DNA，RNA和蛋白质序列数据的特征工程，机器学习分析和建模的集成平台和元学习器
PREAI
分享收藏Meta-learning for evolutionary parameter optimization of classifiers用于分类器进化参数优化的元学习.png)
MACHINE LEARNING
OAAI
MACHINE LEARNINGIF2.9
OAAI分享收藏Coalition game for user association and bandwidth allocation in ultra-dense mmWave networks超密集毫米波网络中用户关联和带宽分配的联盟博弈
PREAI
分享收藏Comparative study of temperature effects on white sandstone and rockburst-like materialsPLOS ONEOAAI
PLOS ONEIF0
OAAI分享收藏分享收藏Taking the Human Out of the Loop: A Review of Bayesian Optimization将人类带出循环: 贝叶斯优化的回顾PROCEEDINGS OF THE IEEE
PROCEEDINGS OF THE IEEEIF25.9
PREAI
分享收藏分享收藏
查看更多内容