Conditional Uncorrelation and Efficient Subset Selection in Sparse Regression

doi:10.1109/TCYB.2021.3062842

Return

Conditional Uncorrelation and Efficient Subset Selection in Sparse Regression

2022-10-01

PRE

DOI：10.1109/TCYB.2021.3062842

Original

Original request for help

Save

Abstract

En 中文

Given m d-dimensional responsors and n d-dimensional predictors, sparse regression finds at most k predictors for each responsor for linear approximation, 1 <= k <= d-1. The key problem in sparse regression is subset selection, which usually suffers from high computational cost. In recent years, many improved approximate methods of subset selection have been published. However, less attention has been paid to the nonapproximate method of subset selection, which is very necessary for many questions in data analysis. Here, we consider sparse regression from the view of correlation and propose the formula of conditional uncorrelation. Then, an efficient nonapproximate method of subset selection is proposed in which we do not need to calculate any coefficients in the regression equation for candidate predictors. By the proposed method, the computational complexity is reduced from O([1/6]k(3)+(m+1)k(2)+mkd) to O([1/6]k(3)+[1/2](m+1)k(2)) for each candidate subset in sparse regression. Because the dimension d is generally the number of observations or experiments and large enough, the proposed method can greatly improve the efficiency of nonapproximate subset selection. We also apply the proposed method in real scenarios of dental age assessment and sparse coding to validate the efficiency of the proposed method.

Keywords:

Correlation

Matching pursuit algorithms

Approximation algorithms

Robots

Multivariate regression

Linear approximation

Encoding

Conditional uncorrelation

dental age assessment

multivariate correlation

sparse coding

sparse regression

subset selection

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.