arrow
返回

Matrix factorization of large scale data using multistage matrix factorization

delete2020-11-25
delete4
PRE
AI
V
Vineet Padmanabhan
DOI:10.1007/s10489-020-01957-0delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Matrix Factorization (MF) is a resource intensive task that consumes significant memory and computational effort and is not scalable with the quantum of data. When the size of the input matrix and the latent feature matrices are higher than the available memory, both on a Central Processing Unit (CPU) as well as a Graphical Processing Unit (GPU), loading all the required matrices on to CPU/GPU memory may not be possible. Such scenarios call for alternative techniques that not only allow parallelism but also address memory limitations and plays a crucial role in industrial applications. In this paper we propose a divide and conquer technique based on a two stage factorization process. In the first step, we divide the data set into different groups and factorize each group. In the second step, we use factorization based learning model to combine the latent features derived in the first step. Our motivation is to develop a method that can achieve both parallelism and scalability as well as address factorization of incrementally growing data. Our contribution is a novel multi-stage matrix factorization (MsMF) approach. The experimental results demonstrate improvements in RMSE as well as computational efficiency.
Keyword:
Multistage matrix factorization
Two-stage matrix factorization
Hierarchical matrix factorization
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Applied Intelligence 封面图
Applied Intelligence
IF:
3.5
论文数:
7.6K
被引数:
1.7W

机构

U
University of Hyderabad
学者数:
3.9K
论文数: 3.2K
被引数: 3.7K
引用论文

引用论文

err
IF0
err
err0
PREAI
err
err分享
err收藏
err分享
err收藏
Proximal maximum margin matrix factorization for collaborative filtering
err2017-01-01
err26
PREAI
errKumar, Vikas; Pujari, Arun K.; Sahu, Sandeep Kumar; Kagita, Venkateswara Rao; Padmanabhan, Vineet
err分享
err收藏
Diffraction based overlay metrology: accuracy and performance on front end stack
err2008-03-14
err0
PREAI
errPhilippe Leray; Shaunee Cheng; Daniel Kandel; Michael Adel; Anat Marchelli; Irina Vakshtein; Mauro Vasconi; Bartlomiej Salski
err分享
err收藏
Nonnegative Matrix Factorization for Signal and Data Analytics
err2019-03-01
err183
errOAAI
errFu, Xiao; Huang, Kejun; Sidiropoulos, Nicholas D.; Ma, Wing-Kin
err分享
err收藏
学者 查看更多内容