返回
An Entropy Weighted Nonnegative Matrix Factorization Algorithm for Feature Representation
DOI:10.1109/TNNLS.2022.3184286.png)
摘要
En 中文
Nonnegative matrix factorization (NMF) has been widely used to learn low-dimensional representations of data. However, NMF pays the same attention to all attributes of a data point, which inevitably leads to inaccurate representations. For example, in a human-face dataset, if an image contains a hat on a head, the hat should be removed or the importance of its corresponding attributes should be decreased during matrix factorization. This article proposes a new type of NMF called entropy weighted NMF (EWNMF), which uses an optimizable weight for each attribute of each data point to emphasize their importance. This process is achieved by adding an entropy regularizer to the cost function and then using the Lagrange multiplier method to solve the problem. Experimental results with several datasets demonstrate the feasibility and effectiveness of the proposed method. The code developed in this study is available at https://github.com/Poisson-EM/Entropy-weighted-NMF.
Keyword:
Entropy
Cost function
Standards
Feature extraction
Dimensionality reduction
Principal component analysis
Manifolds
Clustering
entropy regularizer
low-dimensional representation
nonnegative matrix factorization (NMF)
期刊
IF:
8.9
论文数:
7.6K
被引数:
7.2W
机构
引用论文
Quantitative Performance Evaluation of Uncertainty-Aware Hybrid AADL Designs Using Statistical Model Checking使用统计模型检查对不确定性感知的混合AADL设计进行定量性能评估

