arrow
Return

An interpretable regression approach based on bi-sparse optimization

delete2020-07-11
delete5
PRE
AI
T
T. Yao
何
何静 (Jing He)
田
田英杰 (Yingjie Tian)
DOI:10.1007/s10489-020-01687-3delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Given the increasing amounts of data and high feature dimensionalities in forecasting problems, it is challenging to build regression models that are both computationally efficient and highly accurate. Moreover, regression models commonly suffer from low interpretability when using a single kernel function or a composite of multi-kernel functions to address nonlinear fitting problems. In this paper, we propose a bi-sparse optimization-based regression (BSOR) model and corresponding algorithm with reconstructed row and column kernel matrices in the framework of support vector regression (SVR). The BSOR model can predict continuous output values for given input points while using the zero-norm regularization method to achieve sparse instance and feature sets. Experiments were run on 16 datasets to compare BSOR to SVR, linear programming SVR (LPSVR), least squares SVR (LSSVR), multi-kernel learning SVR (MKLSVR), least absolute shrinkage and selection operator regression (LASSOR), and relevance vector regression (RVR). BSOR significantly outperformed the other six regression models in predictive accuracy, identification of the fewest representative instances, selection of the fewest important features, and interpretability of results, apart from its slightly high runtime.
Keywords:
Data mining
Multi-kernel learning
Sparse learning
Zero-norm regularization
Support vector regression
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Applied Intelligence cover
Applied Intelligence
IF:
3.5
Papers:
7.6K
Citations:
1.7W

Organization

L
Ludong University
Scholars:
5.6K
Papers: 3.3K
Citations: 3.7K
S
Swinburne University of Technology
Scholars:
9.3K
Papers: 1.2W
Citations: 2.0W
C
chinese academy of sciences
Scholars:
56.7W
Papers: 45.0W
Citations: 704
researcher View more organizations
Cited Papers

Cited Papers

Combined Homicide-Suicide in Galveston County
err2001-05-01
err0
PREAI
errAR Felthous; AG Hempel; A Heredia; E Freeman; K Goodness; C Holzer; TJ Bennett; WE Korndorffer
errShare
errSave
Phase engineering of metal nanocatalysts for electrochemical CO2 reduction
err2022-09-01
err0
errOAAI
errYanjie Zhai; Peng Han; Qinbai Yun; Yiyao Ge; Xiao Zhang; Ye Chen; Hua Zhang
errShare
errSave
Giant pyroelectricity in nanomembranes
err2022-07-20
err0
PREAI
errJie Jiang; Lifu Zhang; Chen Ming; Hua Zhou; Pritom Bose; Yuwei Guo; Yang Hu; Baiwei Wang; Zhizhong Chen; Ru Jia; Saloni Pendse; Yu Xiang; Yaobiao Xia; Zonghuan Lu; Xixing Wen; Yao Cai; Chengliang Sun; Gwo-Ching Wang; Toh-Ming Lu; Daniel Gall; Yi-Yang Sun; Nikhil Koratkar; Edwin Fohtung; Yunfeng Shi; Jian Shi
errShare
errSave
errShare
errSave
errShare
errSave
errShare
errSave
err
IF0
err
err0
PREAI
err
errShare
errSave
Least angle regression
err2004-04-01
err7.5K
errOAAI
errEfron, B; Hastie, T; Johnstone, I; Tibshirani, R
errShare
errSave
researcher View more