arrow
Return

Evaluating Collaborative Filtering Recommender Algorithms: A Survey

delete2018-01-01
delete122
delete
OA
AI
M
Mahdi Jalili *
S
Sajad Ahmadian
M
Maliheh Izadi
M
Moradi, Parham
M
Mostafa Salehi
DOI:10.1109/ACCESS.2018.2883742delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Due to the explosion of available information on the Internet, the need for effective means of accessing and processing them has become vital for everyone. Recommender systems have been developed to help users to find what they may be interested in and business owners to sell their products more efficiently. They have found much attention in both academia and industry. A recommender algorithm takes into account user-item interactions, i.e., rating (or purchase) history of users on items, and their contextual information, if available. It then provides a list of potential items for each target user, such that the user is likely to positively rate (or purchase) them. In this paper, we review evaluation metrics used to assess performance of recommendation algorithms. We also survey a number of classical and modern recommendation algorithms and compare their performance in terms of different evaluation metrics on five benchmark datasets. Our experiments show that there is no golden recommendation algorithm showing the best performance in all evaluation metrics. We also find large variability across the datasets. This indicates that one should carefully consider the evaluation criteria in choosing a recommendation algorithm for a particular application.
Keywords:
Recommender systems
collaborative filtering
evaluation metrics
precision
ranking
diversity

Journal

IEEE Access cover
IEEE Access
IF:
3.6
Papers:
9.8W
Citations:
29.4W

Organization

U
University of Kurdistan
Scholars:
2.1K
Papers: 2.1K
Citations: 2.5K
U
University of Tehran
Scholars:
2.4W
Papers: 2.3W
Citations: 2.7W
S
Sharif University of Technology
Scholars:
1.1W
Papers: 1.1W
Citations: 9.5K
U
University Zanjan
Scholars:
2.3K
Papers: 2.1K
Citations: 22
researcher View more organizations
Cited Papers

Cited Papers

Quantum Coherence Engineering in the Integer Quantum Hall Regime
err2012-06-18
err0
errOAAI
errP-A. Huynh; F. Portier; H. le Sueur; G. Faini; U. Gennser; D. Mailly; F. Pierre; W. Wegscheider; P. Roche
errShare
errSave
Circulating Aggregated Platelets, Number of Platelets per Aggregate and Platelet Size in Chronic Dialysis Patients
err1997-01-01
err0
PREAI
errJ. Winkler; J. Fuchs; G. Morduchowicz; G. Boner; J. Sulkiss; I. Weinberger
errShare
errSave
err
IF0
err
err0
PREAI
err
errShare
errSave
Thermal transport properties of uranium dioxide by molecular dynamics simulations
err2008-04-01
err0
PREAI
errTaku Watanabe; Susan B. Sinnott; James S. Tulenko; Robin W. Grimes; Patrick K. Schelling; Simon R. Phillpot
errShare
errSave
Deep hybrid collaborative filtering for Web service recommendation
err2018-11-01
err96
PREAI
errXiong, Ruibin; Wang, Jian; Zhang, Neng; Ma, Yutao
errShare
errSave
Slow Release of Fullerene-Like WS2 Nanoparticles as a Superior Solid Lubrication Mechanism in Composite Matrices
err2001-01-01
err0
PREAI
errL. Rapoport; M. Lvovsky; I. Lapsker; V. Leshinsky; Y. Volovik; Y. Feldman; A. Zak; R. Tenne
errShare
errSave
researcher View more