arrow
返回

Gradient descent algorithms for quantile regression with smooth approximation

delete2011-07-22
delete45
PRE
AI
S
Songfeng Zheng *
DOI:10.1007/s13042-011-0031-2delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Gradient based optimization methods often converge quickly to a local optimum. However, the check loss function used by quantile regression model is not everywhere differentiable, which prevents the gradient based optimization methods from being applicable. As such, this paper introduces a smooth function to approximate the check loss function so that the gradient based optimization methods could be employed for fitting quantile regression model. The properties of the smooth approximation are discussed. Two algorithms are proposed for minimizing the smoothed objective function. The first method directly applies gradient descent, resulting the gradient descent smooth quantile regression model; the second approach minimizes the smoothed objective function in the framework of functional gradient descent by changing the fitted model along the negative gradient direction in each iteration, which yields boosted smooth quantile regression algorithm. Extensive experiments on simulated data and real-world data show that, compared to alternative quantile regression models, the proposed smooth quantile regression algorithms can achieve higher prediction accuracy and are more efficient in removing noninformative predictors.
Keyword:
Quantile regression
Gradient descent
Boosting
Variable selection
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

International Journal of Machine Learning and Cybernetics 封面图
International Journal of Machine Learning and Cybernetics
IF:
2.7
论文数:
3.2K
被引数:
5.6K

机构

暂无机构信息
引用论文

引用论文

STEM‐CL investigations on the influence of stacking faults on the optical emission of cubic GaN epilayers and cubic GaN/AlN multi‐quantum wells
err2015-02-27
err0
PREAI
errR. M. Kemper; P. Veit; C. Mietze; A. Dempewolf; T. Wecker; F. Bertram; J. Christen; J. K. N. Lindner; D. J. As
err分享
err收藏
err分享
err收藏
Quantile regression
err2001-11-01
err3.7K
errOAAI
errKoenker, R; Hallock, KF
err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
学者 查看更多内容