arrow
Return

Extensions to Online Feature Selection Using Bagging and Boosting

delete2018-09-01
delete23
delete
OA
AI
G
Gregory Ditzler *
J
Joseph LaBarck
J
James Ritchie
G
Gail Rosen
R
Robi Polikar
DOI:10.1109/TNNLS.2017.2746107delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Feature subset selection can be used to sieve through large volumes of data and discover the most informative subset of variables for a particular learning problem. Yet, due to memory and other resource constraints (e.g., CPU availability), many of the state-of-the-art feature subset selection methods cannot be extended to high dimensional data, or data sets with an extremely large volume of instances. In this brief, we extend online feature selection (OFS), a recently introduced approach that uses partial feature information, by developing an ensemble of online linear models to make predictions. The OFS approach employs a linear model as the base classifier, which allows the l(0)-norm of the parameter vector to be constrained to perform feature selection leading to sparse linear models. We demonstrate that the proposed ensemble model typically yields a smaller error rate than any single linear model, while maintaining the same level of sparsity and complexity at the time of testing.
Keywords:
Ensembles
feature selection
online learning
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Neural Networks and Learning Systems cover
IEEE Transactions on Neural Networks and Learning Systems
IF:
8.9
Papers:
7.5K
Citations:
7.2W

Organization

D
Drexel University
Scholars:
1.3W
Papers: 1.1W
Citations: 2.2W
R
Rowan University
Scholars:
3.5K
Papers: 2.6K
Citations: 2.2K
U
University of Arizona
Scholars:
3.6W
Papers: 3.2W
Citations: 980
researcher View more organizations