.png){kind=icon}
返回
A Correlation Based Recommendation System for Large Data Sets
.png){kind=icon}
OA
AI
DOI：10.1007/s10723-021-09585-9.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Correlation determination brings out relationships in data that had not been seen before and it is imperative to successfully use the power of correlations for data mining. In this paper, we have used the concepts of correlations to cluster data, and merged it with recommendation algorithms. We have proposed two correlation clustering algorithms (RBACC and LGBACC), that are based on finding Spearman's rank correlation coefficient among data points, and using dimensionality reduction approach (PCA) along with graph theory respectively, to produce high quality hierarchical clusters. Both these algorithms have been tested on real life data (New York yellow cabs dataset taken from ), using distributed and parallel computing (Spark and R). They are found to be scalable and perform better than the existing hierarchical clustering algorithms. These two approaches have been used to replace similarity measures in recommendation algorithms and generate a correlation clustering based recommendation system model. We have combined the power of correlation analysis with that of prediction analysis to propose a better recommendation system. It is found that this model makes better quality recommendations as compared to the random recommendation model. This model has been validated using a real time, large data set (MovieLens dataset, taken from ). The results show that combining correlated points with the predictive power of recommendation algorithms, produce better quality recommendations which are faster to compute. LGBACC has approximately 25% better prediction capability but at the same time takes significantly more prediction time compared to RBACC.
Keyword:
Correlation clustering
Recommendation system model
RBACC
LGBACC
期刊
IF:
2.9
论文数:
762
被引数:
1.2K
机构
引用论文
.png){kind=icon}
GLOBAL WARMING DUE TO GENERATION OF GREENHOUSE GASES PRODUCING OZONE HOLES: ROLE OF EARTH SCIENTISTS AND ECONOMISTS IN SOLVING THE DETRIMENTAL EFFECT OF CLIMATE CHANGE由于产生温室气体导致臭氧层空洞形成而产生的全球变暖：地球科学家和经济学家在解决气候变化不利影响中的作用OAAI
OAAI分享收藏
查看更多内容