EFFICIENT FUNCTIONAL LASSO KERNEL SMOOTHING FOR HIGH-DIMENSIONAL ADDITIVE REGRESSION

doi:10.1214/24-AOS2415

EFFICIENT FUNCTIONAL LASSO KERNEL SMOOTHING FOR HIGH-DIMENSIONAL ADDITIVE REGRESSION

2024-08-01

0

PRE

AI

DOI：10.1214/24-AOS2415

Original

Original request for help

Save

Abstract

En 中文

Smooth backfitting has been proposed and proved as a powerful nonparametric estimation technique for additive regression models in various settings. Existing studies are restricted to cases with a moderate number of covariates and are not directly applicable to high dimensional settings. In this paper, we develop new kernel estimators based on the idea of smooth backfitting for high dimensional additive models. We introduce a novel penalization scheme, combining the idea of functional Lasso with the smooth backfitting technique. We investigate the theoretical properties of the functional Lasso smooth backfitting estimation. For the implementation of the proposed method, we devise a simple iterative algorithm where the iteration is defined by a truncated projection operator. The algorithm has only an additional thresholding operator over the projection-based iteration of the smooth backfitting algorithm. We further present a debiased version of the proposed estimator with implementation details, and investigate its theoretical properties for statistical inference. We demonstrate the finite sample performance of the methods via simulation and real data analysis.

Keywords:

Nonparametric regression

additive models

kernel smoothing

smooth backfitting

Key sparse estimation

penalization

functional Lasso

regression

debiasing

EFFICIENT FUNCTIONAL LASSO KERNEL SMOOTHING FOR HIGH-DIMENSIONAL ADDITIVE REGRESSION

Abstract

Journal

Organization