arrow
Return

Parallel-FST: A feature selection library for multicore clusters

delete2022-11-01
delete0
delete
OA
AI
B
Bieito Beceiro *
J
Jorge González‐Domínguez
J
Juan Touriño
DOI:10.1016/j.jpdc.2022.06.012delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Feature selection is a subfield of machine learning focused on reducing the dimensionality of datasets by performing a computationally intensive process. This work presents Parallel-FST, a publicly available parallel library for feature selection that includes seven methods which follow a hybrid MPI/multithreaded approach to reduce their runtime when executed on high performance computing systems. Performance tests were carried out on a 256-core cluster, where Parallel-FST obtained speedups of up to 229x for representative datasets and it was able to analyze a 512 GB dataset, which was not previously possible with a sequential counterpart library due to memory constraints. (C) 2022 The Author(s). Published by Elsevier Inc.
Keywords:
Feature selection
Mutual information
MPI
Hyper Threading
High performance computing
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Journal of Parallel and Distributed Computing cover
Journal of Parallel and Distributed Computing
IF:
4
Papers:
3.8K
Citations:
4.8K

Organization

U
Universidade da Coruna
Scholars:
6.6K
Papers: 5.7K
Citations: 11