arrow
Return

Bring Your Own Learner! A Cloud-Based, Data-Parallel Commons for Machine Learning

delete2015-02-01
delete14
PRE
AI
I
Ignacio Arnaldo *
K
Kalyan Veeramachaneni
A
Andrew H. Song
U
Una-May O’Reilly
DOI:10.1109/MCI.2014.2369892delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
We introduce FCUBE, a cloud-based framework that enables machine learning researchers to contribute their learners to its community-shared repository. FCUBE exploits data parallelism in lieu of algorithmic parallelization to allow its users to efficiently tackle large data problems automatically. It passes random subsets of data generated via resampling to multiple learners that it executes simultaneously and then it combines their model predictions with a simple fusion technique. It is an example of what we have named a Bring Your Own Learner model. It allows multiple machine learning researchers to contribute algorithms in a plug-and-play style. We contend that the Bring Your Own Learner model signals a design shift in cloud-based machine learning infrastructure because it is capable of executing anyone's supervised machine learning algorithm. We demonstrate FCUBE executing five different learners contributed by three different machine learning groups on a 100 node deployment on Amazon EC2. They collectively solve a publicly available classification problem trained with 11 million exemplars from the Higgs dataset.
Keywords:
LARGE-SCALE DATA
ENSEMBLE
BENCHMARKING
ALGORITHMS
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Computational Intelligence Magazine cover
IEEE Computational Intelligence Magazine
IF:
11.2
Papers:
606
Citations:
3.1K

Organization

No organization information available