arrow
Return

Adaptive pruning algorithm for least squares support vector machine classifier

delete2009-05-20
delete33
PRE
AI
杨晓伟 cover
杨晓伟 (Xiaowei Yang) *
J
Jie Lü
张
张广泉 (Guangquan Zhang)
DOI:10.1007/s00500-009-0434-0delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
As a new version of support vector machine (SVM), least squares SVM (LS-SVM) involves equality instead of inequality constraints and works with a least squares cost function. A well-known drawback in the LS-SVM applications is that the sparseness is lost. In this paper, we develop an adaptive pruning algorithm based on the bottom-to-top strategy, which can deal with this drawback. In the proposed algorithm, the incremental and decremental learning procedures are used alternately and a small support vector set, which can cover most of the information in the training set, can be formed adaptively. Using this set, one can construct the final classifier. In general, the number of the elements in the support vector set is much smaller than that in the training set and a sparse solution is obtained. In order to test the efficiency of the proposed algorithm, we apply it to eight UCI datasets and one benchmarking dataset. The experimental results show that the presented algorithm can obtain adaptively the sparse solutions with losing a little generalization performance for the classification problems with no-noises or noises, and its training speed is much faster than sequential minimal optimization algorithm (SMO) for the large-scale classification problems with no-noises.
Keywords:
Support vector machine
Least squares support vector machine
Pruning
Incremental learning
Decremental learning
Adaptive

Journal

Soft Computing cover
Soft Computing
IF:
2.5
Papers:
1.0W
Citations:
2.1W

Organization

U
university of technology sydney
Scholars:
1.6W
Papers: 2.0W
Citations: 25
S
south china university of technology
Scholars:
6.8W
Papers: 5.1W
Citations: 85
Cited Papers

Cited Papers

Giant pyroelectricity in nanomembranes
err2022-07-20
err0
PREAI
errJie Jiang; Lifu Zhang; Chen Ming; Hua Zhou; Pritom Bose; Yuwei Guo; Yang Hu; Baiwei Wang; Zhizhong Chen; Ru Jia; Saloni Pendse; Yu Xiang; Yaobiao Xia; Zonghuan Lu; Xixing Wen; Yao Cai; Chengliang Sun; Gwo-Ching Wang; Toh-Ming Lu; Daniel Gall; Yi-Yang Sun; Nikhil Koratkar; Edwin Fohtung; Yunfeng Shi; Jian Shi
errShare
errSave
Diseases and Molecular Diagnostics: A Step Closer to Precision Medicine
err2017-08-22
err0
errOAAI
errShailendra Dwivedi; Purvi Purohit; Radhieka Misra; Puneet Pareek; Apul Goel; Sanjay Khattri; Kamlesh Kumar Pant; Sanjeev Misra; Praveen Sharma
errShare
errSave
Influence of CYP3A5 and drug transporter polymorphisms on imatinib trough concentration and clinical response among patients with chronic phase chronic myeloid leukemia
err2010-08-19
err0
errOAAI
errNaoto Takahashi; Masatomo Miura; Stuart A Scott; Hideaki Kagaya; Yoshihiro Kameoka; Hiroyuki Tagawa; Hirobumi Saitoh; Naohito Fujishima; Tomoko Yoshioka; Makoto Hirokawa; Kenichi Sawada
errShare
errSave
Benchmarking least squares support vector machine classifiers
err2004-01-01
err547
errOAAI
errvan Gestel, T; Suykens, JAK; Baesens, B; Viaene, S; Vanthienen, J; Dedene, G; de Moor, B; Vandewalle, J
errShare
errSave
Weighted least squares support vector machines: robustness and sparse approximation
err2002-10-01
err1.3K
errOAAI
errSuykens, JAK; De Brabanter, J; Lukas, L; Vandewalle, J
errShare
errSave
Choosing multiple parameters for support vector machines
err2002-01-01
err2.0K
errOAAI
errChapelle, O; Vapnik, V; Bousquet, O; Mukherjee, S
errShare
errSave
researcher View more