arrow
Return

Fast and Low Memory Cost Matrix Factorization: Algorithm, Analysis, and Case Study

delete2020-02-01
delete3
PRE
AI
Y
Yan Yan *
谭明奎 cover
谭明奎 (Mingkui Tan)
I
Ivor W. Tsang
Y
Yi Yang
Q
Qinfeng Shi
张承启 (Chengqi Zhang)
DOI:10.1109/TKDE.2018.2882197delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Matrix factorization has been widely applied to various applications. With the fast development of storage and internet technologies, we have been witnessing a rapid increase of data. In this paper, we propose new algorithms for matrix factorization with the emphasis on efficiency. In addition, most existing methods of matrix factorization only consider a general smooth least square loss. Differently, many real-world applications have distinctive characteristics. As a result, different losses should be used accordingly. Therefore, it is beneficial to design new matrix factorization algorithms that are able to deal with both smooth and non-smooth losses. To this end, one needs to analyze the characteristics of target data and use the most appropriate loss based on the analysis. We particularly study two representative cases of low-rank matrix recovery, i.e., collaborative filtering for recommendation and high dynamic range imaging. To solve these two problems, we respectively propose a stage-wise matrix factorization algorithm by exploiting manifold optimization techniques. From our theoretical analysis, they are both are provably guaranteed to converge to a stationary point. Extensive experiments on recommender systems and high dynamic range imaging demonstrate the satisfactory performance and efficiency of our proposed method on large-scale real data.
Keywords:
Imaging
Optimization
Recommender systems
Manifolds
Convergence
Minimization
Dynamic range
Matrix factorization
matrix recovery
efficient optimization
convergence guarantees
recommender systems
HDR imaging
batch image alignment
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Knowledge and Data Engineering cover
IEEE Transactions on Knowledge and Data Engineering
IF:
10.4
Papers:
6.8K
Citations:
3.2W

Organization

U
University of Adelaide
Scholars:
2.3W
Papers: 2.4W
Citations: 4.2W
U
university of technology sydney
Scholars:
1.6W
Papers: 2.0W
Citations: 25
S
south china university of technology
Scholars:
6.7W
Papers: 5.1W
Citations: 85
researcher View more organizations