返回
Structured Dimensionality Reduction for Additive Model Regression
DOI:10.1109/TKDE.2016.2525996.png)
摘要
En 中文
Additive models are regression methods which model the response variable as the sum of univariate transfer functions of the input variables. Key benefits of additive models are their accuracy and interpretability on many real-world tasks. Additive models are however not adapted to problems involving a large number (e.g., hundreds) of input variables, as they are prone to overfitting in addition to losing interpretability. In this paper, we introduce a novel framework for applying additive models to a large number of input variables. The key idea is to reduce the task dimensionality by deriving a small number of new covariates obtained by linear combinations of the inputs, where the linear weights are estimated with regard to the regression problem at hand. The weights are moreover constrained to prevent overfitting and facilitate the interpretation of the derived covariates. We establish identifiability of the proposed model under mild assumptions and present an efficient approximate learning algorithm. Experiments on synthetic and real-world data demonstrate that our approach compares favorably to baseline methods in terms of accuracy, while resulting in models of lower complexity and yielding practical insights into high-dimensional real-world regression tasks. Our framework broadens the applicability of additive models to high-dimensional problems while maintaining their interpretability and potential to provide practical insights.
Keyword:
Nonparametric regression
additive models
mixed integer programming
interpretability
projection pursuit regression
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
10.4
论文数:
6.8K
被引数:
3.2W
机构
引用论文
Dimensionality reduction by Mixed Kernel Canonical Correlation Analysis基于混合核典型相关分析的降维方法
PATTERN RECOGNITION
IF7.6
Self-taught dimensionality reduction on the high-dimensional small-sized data
PATTERN RECOGNITION
IF7.6
Local Short and Middle Term Electricity Load Forecasting With Semi-Parametric Additive Models基于半参数可加模型的局部中短期电力负荷预测
Some relationships between the biochemistry of photosynthesis and the gas exchange of leaves光合作用的生物化学与叶片气体交换之间的某些关系
Planta
IF0

