arrow
Return

Evaluating collaborative filtering recommender systems

delete2004-01-01
delete3.9K
PRE
AI
J
Jonathan L. Herlocker
J
Joseph A. Konstan
T
Terveen, K
R
Riedl, JT
DOI:10.1145/963770.963772delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Recommender systems have been evaluated in many, often incomparable, ways. In this article, we review the key decisions in evaluating collaborative filtering recommender systems: the user tasks being evaluated, the types of analysis and datasets being used, the ways in which prediction quality is measured, the evaluation of prediction attributes other than quality, and the user-based evaluation of the system as a whole. In addition to reviewing the evaluation strategies used by prior researchers, we present empirical results from the analysis of various accuracy metrics on one content domain where all the tested metrics collapsed roughly into three equivalence classes. Metrics within each equivalency class were strongly correlated, while metrics from different equivalency classes were uncorrelated.
Keywords:
experimentation
measurement
performance
collaborative filtering
recommender systems
metrics
evaluation
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

ACM Transactions on Information Systems cover
ACM Transactions on Information Systems
IF:
9.1
Papers:
1.2K
Citations:
4.7K

Organization

No organization information available
Cited Papers

Cited Papers

GroupLens: Applying collaborative filtering to Usenet news
err1997-03-01
err1.5K
errOAAI
errKonstan, JA; Miller, BN; Maltz, D; Herlocker, JL; Gordon, LR; Riedl, J
errShare
errSave
Recommender systems
err1997-03-01
err2.4K
errOAAI
errResnick, P; Varian, HR
errShare
errSave
errShare
errSave
Waste from peach (Prunus persica) processing used for optimisation of carotenoids ethanolic extraction
err2016-12-29
err0
PREAI
errEmanuela Flor de Vargas; André Jablonski; Simone Hickmann Flôres; Alessandro de Oliveira Rios
errShare
errSave
Fab: Content-based, collaborative recommendation
err1997-03-01
err2.0K
errOAAI
errBalabanovic, M; Shoham, Y
errShare
errSave
researcher View more