arrow
返回

Online Feature Selection and Its Applications

delete2014-03-01
delete191
delete
OA
AI
J
Jialei Wang *
P
Peilin Zhao
S
Steven C. H. Hoi
靳
靳榕 (Rong Jin)
DOI:10.1109/TKDE.2013.32delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Feature selection is an important technique for data mining. Despite its importance, most studies of feature selection are restricted to batch learning. Unlike traditional batch learning methods, online learning represents a promising family of efficient and scalable machine learning algorithms for large-scale applications. Most existing studies of online learning require accessing all the attributes/features of training instances. Such a classical setting is not always appropriate for real-world applications when data instances are of high dimensionality or it is expensive to acquire the full set of attributes/features. To address this limitation, we investigate the problem of online feature selection (OFS) in which an online learner is only allowed to maintain a classifier involved only a small and fixed number of features. The key challenge of online feature selection is how to make accurate prediction for an instance using a small number of active features. This is in contrast to the classical setup of online learning where all the features can be used for prediction. We attempt to tackle this challenge by studying sparsity regularization and truncation techniques. Specifically, this article addresses two different tasks of online feature selection: 1) learning with full input, where an learner is allowed to access all the features to decide the subset of active features, and 2) learning with partial input, where only a limited number of features is allowed to be accessed for each instance by the learner. We present novel algorithms to solve each of the two problems and give their performance analysis. We evaluate the performance of the proposed algorithms for online feature selection on several public data sets, and demonstrate their applications to real-world problems including image classification in computer vision and microarray gene expression analysis in bioinformatics. The encouraging results of our experiments validate the efficacy and efficiency of the proposed techniques.
Keyword:
Feature selection
online learning
large-scale data mining
classification
big data analytics

期刊

IEEE Transactions on Knowledge and Data Engineering 封面图
IEEE Transactions on Knowledge and Data Engineering
IF:
10.4
论文数:
6.8K
被引数:
3.2W

机构

N
Nanyang Technological University
学者数:
4.9W
论文数: 4.8W
被引数: 8.1W
M
michigan state university
学者数:
3.6W
论文数: 3.2W
被引数: 44
引用论文

引用论文

The electroneutrality approximation in electrochemistry电化学中的电中性近似
err2011-02-22
err0
PREAI
errEdmund J. F. Dickinson; Juan G. Limon-Petersen; Richard G. Compton
err分享
err收藏
err分享
err收藏
Distinct effects of TRAIL on the mitochondrial network in human cancer cells and normal cells: role of plasma membrane depolarization
err2015-05-25
err0
errOAAI
errYoshihiro Suzuki-Karasaki; Kyoko Fujiwara; Kosuke Saito; Miki Suzuki-Karasaki; Toyoko Ochiai; Masayoshi Soma
err分享
err收藏
Genetic Background Affects the Mucosal Secretory IgA Levels, Parasite Burden, Lung Inflammation, and Mouse Susceptibility toAscaris suumInfection
err2022-02-17
err0
errOAAI
errLuciana Maria Oliveira; Denise Silva Nogueira; Ricardo Marcelo Geraldi; Fernando Sérgio Barbosa; Chiara Cássia Oliveira Amorim; Ana Clara Gazzinelli-Guimarães; Nathália Maria Resende; Natália Pinheiro-Rosa; Lucas Rocha Kraemer; Matheus Silvério Mattos; Lilian Lacerda Bueno; Ana Maria Caetano Faria; Remo Castro Russo; Soraya Gaze; Ricardo Toshio Fujiwara
err分享
err收藏
err分享
err收藏
err分享
err收藏
学者 查看更多内容