arrow
Return

Non-negative matrix factorization with α-divergence

delete2008-07-01
delete113
delete
OA
AI
A
Andrzej Cichocki
Y
Yong‐Deok Kim
S
Seungjin Choi *
DOI:10.1016/j.patrec.2008.02.016delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Non-negative matrix factorization (NMF) is a popular technique for pattern recognition, data analysis, and dimensionality reduction, the goal of which is to decompose non-negative data matrix X into a product of basis matrix A and encoding variable matrix S with both A and S allowed to have only non-negative elements. In this paper, we consider Amari's alpha-divergence as a discrepancy measure and rigorously derive a multiplicative updating algorithm (proposed in our recent work) which iteratively minimizes the alpha-divergence between X and AS. We analyze and prove the monotonic convergence of the algorithm using auxiliary functions. In addition, we show that the same algorithm can be also derived using Karush-Kuhn-Tucker (KKT) conditions as well as the projected gradient. We provide two empirical study for image denoising and EEG classification, showing the interesting and useful behavior of the algorithm in cases where different values of alpha (alpha = 0.5,1,2) are used. (C) 2008 Elsevier B.V. All rights reserved.
Keywords:
alpha-divergence
multiplicative updates
non-negative matrix factorization
projected gradient
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Pattern Recognition Letters cover
Pattern Recognition Letters
IF:
3.3
Papers:
7.9K
Citations:
1.6W

Organization

R
riken
Scholars:
2.2W
Papers: 1.9W
Citations: 24