返回
Accelerating Random Forest on Memory-Constrained Devices Through Data Storage Optimization
DOI:10.1109/TC.2022.3215898.png)
摘要
En 中文
Random forests is a widely used classification algorithm. It consists of a set of decision trees each of which is a classifier built on the basis of a random subset of the training data-set. In an environment where the memory work-space is low in comparison to the data-set size, when training a decision tree, a large proportion of the execution time is related to I/O operations. These are caused by data blocks transfers between the storage device and the memory work-space (in both directions). Our analysis of random forests training algorithms showed that there are two major issues : (1) Block Under-utilization: data blocks are poorly used when loaded into memory and have to be reloaded multiple times, meaning that the algorithm exhibits a poor spatial locality; (2) Data Over-read: the data-set is supposed to be fully loaded in memory whereas a large proportion of data are not effectively useful when building a decision tree. Our proposed solution is structured to address these two issues. First, we propose to reorganize the data-set in such a way to enhance spatial locality and second, to remove the assumption that the data-set is entirely loaded into memory and access data only when effectively needed. Our experiments show that this method made it possible to reduce random forest building time by 51 to 95% in comparison to a state-of-the-art method.
Keyword:
Decision trees
Random forests
Buildings
Radio frequency
Optimization
Training
Loading
memory hierarchy
I/O accesses reduction
embedded systems
期刊
IF:
3.8
论文数:
5.4K
被引数:
9.8K
机构
引用论文
UbeHealth: A Personalized Ubiquitous Cloud and Edge-Enabled Networked Healthcare System for Smart Cities
IEEE ACCESS
IF3.6
Strong NF-kB-DNA binding parallels cyclooxygenase-2 gene transcription in aging and in sporadic Alzheimer’s disease superior temporal lobe neocortex.强NF-kB-DNA结合与环氧化酶-2基因转录在衰老和散发性阿尔茨海默病颞上叶新皮质中平行。
THE EFFECTS OF WORK ENVIRONMENTAL FACTORS ON JOB SATISFACTION: THE MEDIATING ROLE OF WORK MOTIVATION

