arrow
返回

Structured Dimensionality Reduction for Additive Model Regression

delete2016-06-01
delete4
delete
OA
AI
A
Alhussein Fawzi
J
Jean-Baptiste Fiot
B
Bei Chen
M
Mathieu Sinn *
P
Pascal Frossard *
DOI:10.1109/TKDE.2016.2525996delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Additive models are regression methods which model the response variable as the sum of univariate transfer functions of the input variables. Key benefits of additive models are their accuracy and interpretability on many real-world tasks. Additive models are however not adapted to problems involving a large number (e.g., hundreds) of input variables, as they are prone to overfitting in addition to losing interpretability. In this paper, we introduce a novel framework for applying additive models to a large number of input variables. The key idea is to reduce the task dimensionality by deriving a small number of new covariates obtained by linear combinations of the inputs, where the linear weights are estimated with regard to the regression problem at hand. The weights are moreover constrained to prevent overfitting and facilitate the interpretation of the derived covariates. We establish identifiability of the proposed model under mild assumptions and present an efficient approximate learning algorithm. Experiments on synthetic and real-world data demonstrate that our approach compares favorably to baseline methods in terms of accuracy, while resulting in models of lower complexity and yielding practical insights into high-dimensional real-world regression tasks. Our framework broadens the applicability of additive models to high-dimensional problems while maintaining their interpretability and potential to provide practical insights.
Keyword:
Nonparametric regression
additive models
mixed integer programming
interpretability
projection pursuit regression
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Knowledge and Data Engineering 封面图
IEEE Transactions on Knowledge and Data Engineering
IF:
10.4
论文数:
6.8K
被引数:
3.2W

机构

E
Ecole Polytechnique Federale de Lausanne
学者数:
1.7W
论文数: 1.3W
被引数: 25
S
swiss federal institutes of technology domain
学者数:
9.0W
论文数: 8.0W
被引数: 163
引用论文

引用论文

Dimensionality reduction by Mixed Kernel Canonical Correlation Analysis基于混合核典型相关分析的降维方法
err2012-08-01
err141
PREAI
errZhu, Xiaofeng; Huang, Zi; Shen, Heng Tao; Cheng, Jian; Xu, Changsheng
err分享
err收藏
Self-taught dimensionality reduction on the high-dimensional small-sized data
err2013-01-01
err154
PREAI
errZhu, Xiaofeng; Huang, Zi; Yang, Yang; Shen, Heng Tao; Xu, Changsheng; Luo, Jiebo
err分享
err收藏
err分享
err收藏
Sparse additive models
err2009-10-19
err423
errOAAI
errRavikumar, Pradeep; Lafferty, John; Liu, Han; Wasserman, Larry
err分享
err收藏
学者 查看更多内容