arrow
Return

Runtime Optimizations for Tree-based Machine Learning Models

delete2014-09-01
delete49
delete
OA
AI
N
Nima Asadi *
J
Jimmy Lin
A
Arjen P. de Vries
DOI:10.1109/TKDE.2013.73delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Tree-based models have proven to be an effective solution for web ranking as well as other machine learning problems in diverse domains. This paper focuses on optimizing the runtime performance of applying such models to make predictions, specifically using gradient-boosted regression trees for learning to rank. Although exceedingly simple conceptually, most implementations of tree-based models do not efficiently utilize modern superscalar processors. By laying out data structures in memory in a more cache-conscious fashion, removing branches from the execution flow using a technique called predication, and micro-batching predictions using a technique called vectorization, we are able to better exploit modern processor architectures. Experiments on synthetic data and on three standard learning-to-rank datasets show that our approach is significantly faster than standard implementations.
Keywords:
Web search
general information storage and retrieval
information technology and systems
scalability and efficiency
learning to rank
regression trees
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Knowledge and Data Engineering cover
IEEE Transactions on Knowledge and Data Engineering
IF:
10.4
Papers:
6.8K
Citations:
3.2W

Organization

University System of Maryland cover
University System of Maryland
Scholars:
6.4W
Papers: 5.6W
Citations: 113
Cited Papers

Cited Papers

errShare
errSave
errShare
errSave
Breaking the Memory Wall in MonetDB
err2008-12-01
err143
errOAAI
errBoncz, Peter A.; Kersten, Martin L.; Manegold, Stefan
errShare
errSave
errShare
errSave
The polo-like kinase inhibitor BI 2536 exhibits potent activity against malignant plasma cells and represents a novel therapy in multiple myeloma
err2011-03-01
err0
errOAAI
errHelen J. Stewart; Lyudmila Kishikova; Fiona L. Powell; Sally P. Wheatley; Timothy J. Chevassut
errShare
errSave
Transcription Impacts the Efficiency of mRNA Translation via Co-transcriptional N6-adenosine Methylation
errCell
IF0
err2017-04-01
err0
errOAAI
errBoris Slobodin; Ruiqi Han; Vittorio Calderone; Joachim A.F. Oude Vrielink; Fabricio Loayza-Puch; Ran Elkon; Reuven Agami
errShare
errSave
researcher View more