arrow
返回

Accelerating Random Forest on Memory-Constrained Devices Through Data Storage Optimization

delete2023-06-01
delete4
PRE
AI
C
Camélia Slimani *
C
Chun-Feng Wu
S
Stéphane Rubini
Y
Yuan-Hao Chang
J
Jalil Boukhobza
DOI:10.1109/TC.2022.3215898delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Random forests is a widely used classification algorithm. It consists of a set of decision trees each of which is a classifier built on the basis of a random subset of the training data-set. In an environment where the memory work-space is low in comparison to the data-set size, when training a decision tree, a large proportion of the execution time is related to I/O operations. These are caused by data blocks transfers between the storage device and the memory work-space (in both directions). Our analysis of random forests training algorithms showed that there are two major issues : (1) Block Under-utilization: data blocks are poorly used when loaded into memory and have to be reloaded multiple times, meaning that the algorithm exhibits a poor spatial locality; (2) Data Over-read: the data-set is supposed to be fully loaded in memory whereas a large proportion of data are not effectively useful when building a decision tree. Our proposed solution is structured to address these two issues. First, we propose to reorganize the data-set in such a way to enhance spatial locality and second, to remove the assumption that the data-set is entirely loaded into memory and access data only when effectively needed. Our experiments show that this method made it possible to reduce random forest building time by 51 to 95% in comparison to a state-of-the-art method.
Keyword:
Decision trees
Random forests
Buildings
Radio frequency
Optimization
Training
Loading
memory hierarchy
I/O accesses reduction
embedded systems

期刊

IEEE Transactions on Computers 封面图
IEEE Transactions on Computers
IF:
3.8
论文数:
5.4K
被引数:
9.8K

机构

U
universite de bretagne occidentale
学者数:
7.2K
论文数: 5.0K
被引数: 6
C
centre national de la recherche scientifique (cnrs)
学者数:
24.5W
论文数: 18.2W
被引数: 279
A
academia sinica - taiwan
学者数:
1.9W
论文数: 1.6W
被引数: 17
N
National Yang Ming Chiao Tung University
学者数:
2.5W
论文数: 2.3W
被引数: 2.2W
学者 查看更多机构
引用论文

引用论文

UbeHealth: A Personalized Ubiquitous Cloud and Edge-Enabled Networked Healthcare System for Smart Cities
err2018-01-01
err154
errOAAI
errMuhammed, Thaha; Mehmood, Rashid; Albeshri, Aiiad; Katib, Iyad
err分享
err收藏
A scalable bootstrap for massive data
err2014-03-17
err286
errOAAI
errKleiner, Ariel; Talwalkar, Ameet; Sarkar, Purnamrita; Jordan, Michael I.
err分享
err收藏
Random Forests for Big Data
err2017-09-01
err250
errOAAI
errGenuer, Robin; Poggi, Jean-Michel; Tuleau-Malot, Christine; Villa-Vialaneix, Nathalie
err分享
err收藏
The reparative capacity of different bioactive dental materials for direct pulp capping
err2018-06-30
err0
errOAAI
errEhab Mohamed Kamal; Sameh Mahmoud Nabih; Raneem Farouk Obeid; Mohamed Ayad Abdelhameed
err分享
err收藏
Estrogenic and antiproliferative activities of isoliquiritigenin in MCF7 breast cancer cells
err2002-11-01
err0
PREAI
errMarcello Maggiolini; Giancarlo Statti; Adele Vivacqua; Sabrina Gabriele; Vittoria Rago; Monica Loizzo; Francesco Menichini; Sebastiano Amdò
err分享
err收藏
Role of EspF in host cell death induced by enteropathogenic Escherichia coli
err2001-04-01
err0
PREAI
errJohn K. Crane; Barry P. McNamara; Michael S. Donnenberg
err分享
err收藏
学者 查看更多内容