arrow
Return

Sparse Nonnegative Interaction Models

delete2021-01-01
delete0
delete
OA
AI
M
Mirai Takayanagi
Y
Yasuo Tabei
E
Einoshin Suzuki
H
Hiroto Saigo *
DOI:10.1109/ACCESS.2021.3099473delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Non-negative least square regression (NLS) is a constrained least squares problem where the coefficients are restricted to be non-negative. It is useful for modeling non-negative responses such as time measurements, count data, histograms and so on. Existing NLS solvers are designed for cases where the predictor variables and response variables have linear relationships, and do not consider interactions among predictor variables. In this paper, we solve NLS in the complete space of power sets of variables. Such an extension is particularly useful in biology, for modeling genetic associations. Our new algorithms solve NLS problems exactly while decreasing computational burden by using an active set method. The algorithm proceeds in an iterative fashion, such that an optimal interaction term is searched by a branch-and-bound subroutine, and added to the solution set one another. The resulting large search space is efficiently restricted by novel pruning conditions and two kinds of sparsity promoting regularization; l(1) norm and non-negativity constraints. In computational experiments using HIV-1 datasets, 99% of the search space was safely pruned without losing the optimal variables. In mutagenicity datasets, the proposed method could identify long and accurate patterns compared to the original NLS. Codes are available from https://github.com/afiveithree/inlars.
Keywords:
LASSO/LARS
itemset mining
nonnegative least squares
variable interaction
interpretable machine learning
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Access cover
IEEE Access
IF:
3.6
Papers:
9.8W
Citations:
29.4W

Organization

K
Kyushu University
Scholars:
3.2W
Papers: 2.6W
Citations: 2.8W
R
riken
Scholars:
2.2W
Papers: 1.9W
Citations: 24