arrow
Return

Bi-level algorithm for optimizing hyperparameters in penalized nonnegative matrix factorization

delete2023-11-01
delete3
delete
OA
AI
N
Nicoletta Del Buono
F
Flavia Esposito
L
Laura Selicato *
R
Rafał Zdunek
DOI:10.1016/j.amc.2023.128184delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Learning approaches rely on hyperparameters that impact the algorithm's performance and affect the knowledge extraction process from data. Recently, Nonnegative Matrix Factoriza-tion (NMF) has attracted a growing interest as a learning algorithm. This technique cap-tures the latent information embedded in large datasets while preserving feature proper-ties. NMF can be formalized as a penalized optimization task in which tuning the penalty hyperparameters is an open issue. The current literature does not provide any general framework addressing this task. This study proposes to express the penalty hyperparam-eters problem in NMF in terms of a bi-level optimization. We design a novel algorithm, named Alternating Bi-level (AltBi), which incorporates the hyperparameters tuning proce-dure into the updates of NMF factors. Results of the existence and convergence of numer-ical solutions, under appropriate assumptions, are studied, and numerical experiments are provided.& COPY; 2023 Elsevier Inc. All rights reserved.
Keywords:
Nonnegative matrix factorization
Hyperparameter optimization
Penalty coefficient
Low -rank approximation
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Applied Mathematics and Computation cover
Applied Mathematics and Computation
IF:
3.4
Papers:
2.3W
Citations:
3.3W

Organization

U
universita degli studi di bari aldo moro
Scholars:
2.1W
Papers: 1.6W
Citations: 9
W
wroclaw university of science & technology
Scholars:
7.4K
Papers: 7.1K
Citations: 2