arrow
Return

Orthogonal Nonnegative Matrix Factorization using a novel deep Autoencoder Network

delete2021-09-01
delete21
PRE
AI
M
Mingming Yang
S
Songhua Xu *
DOI:10.1016/j.knosys.2021.107236delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Orthogonal Nonnegative Matrix Factorization (ONMF) offers an important analytical vehicle for addressing many problems. Encouraged by record-breaking successes attained by neural computing models in solving an assortment of data analytics tasks, a rich collection of neural computing models has been proposed to perform ONMF with compelling performance. Such existing models can be broadly classified into the shallow-layered structure (SLS) based and deep-layered structure (DLS) based models. However, SLS models cannot capture complex relationships and hierarchical information latent in a matrix due to their simple network structures and DLS models rely on an iterative procedure to derive weights, leading to a less efficient solution process and cannot be reused to factorize new matrices. To overcome these shortcomings, this paper proposes a novel deep autoencoder network for ONMF, which is abbreviated as DAutoED-ONMF. Compared with SLS models, the newly proposed model is capable of generating solutions with good interpretability and solution uniqueness like original SLS models, yet the new model attains a superior learning capability thanks to its deep structure employed. In comparison with DLS models, the new model trains a reusable encoder network to directly factorize any given matrix with no need to repeatedly retrain the model for factorizing multiple matrices using a tailor-designed network training procedure. Proof of the procedure's convergence is presented with an analysis of its computational complexity. The numerical experiments conducted on several publicly data sets convincingly demonstrate that the proposed DAutoED-ONMF model gains promising performance in terms of multiple metrics. (C) 2021 Elsevier B.V. All rights reserved.
Keywords:
Orthogonal Nonnegative Matrix
Factorization
Deep autoencoder network
Auxiliary function
Multiplication update rule
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

K
Knowledge-Based Systems
IF:
7.6
Papers:
1.3W
Citations:
4.5W

Organization

X
xi'an jiaotong university
Scholars:
9.3W
Papers: 6.7W
Citations: 75
Cited Papers

Cited Papers

Stability of Reference Genes for Messenger RNA Quantification by Real-Time PCR in Mouse Dextran Sodium Sulfate Experimental Colitis
err2016-05-31
err0
errOAAI
errNour Eissa; Hayam Hussein; Hongxing Wang; Mohammad F. Rabbi; Charles N. Bernstein; Jean-Eric Ghia
errShare
errSave
Automated analysis of retinal imaging using machine learning techniques for computer vision
err2016-07-05
err0
errOAAI
errJeffrey De Fauw; Pearse Keane; Nenad Tomasev; Daniel Visentin; George van den Driessche; Mike Johnson; Cian O Hughes; Carlton Chu; Joseph Ledsam; Trevor Back; Tunde Peto; Geraint Rees; Hugh Montgomery; Rosalind Raine; Olaf Ronneberger; Julien Cornebise
errShare
errSave
errShare
errSave
Multi-view clustering by non-negative matrix factorization with co-orthogonal constraints
err2020-04-01
err91
PREAI
errLiang, Naiyao; Yang, Zuyuan; Li, Zhenni; Sun, Weijun; Xie, Shengli
errShare
errSave
Two algorithms for orthogonal nonnegative matrix factorization with application to clustering
err2014-10-01
err144
errOAAI
errPompili, Filippo; Gillis, Nicolas; Absil, P. -A.; Glineur, Francois
errShare
errSave
A novel regularized concept factorization for document clustering
err2017-11-01
err23
PREAI
errYan, Wei; Zhang, Bob; Ma, Sihan; Yang, Zuyuan
errShare
errSave
Attribute mapping and autoencoder neural network based matrix factorization initialization for recommendation systems
err2019-02-01
err37
PREAI
errZhao, Jianli; Geng, Xijiao; Zhou, Jiehan; Sun, Qiuxia; Xiao, Yu; Zhang, Zeli; Fu, Zhengbin
errShare
errSave
researcher View more