返回
Do patterns help novice evaluators? A comparative study
DOI:10.1016/j.ijhcs.2010.07.005.png)
摘要
En 中文
Evaluating e learning systems is a complex activity which requires considerations of several criteria addressing quality in use as well as educational quality Heuristic evaluation is a widespread method for usability evaluation, yet its output is often prone to subjective variability, primarily due to the generality of many heuristics This paper presents the pattern based (PB) inspection, which aims at reducing this drawback by exploiting a set of evaluation patterns to systematically drive inspectors in their evaluation activities The application of PB inspection to the evaluation of e learning systems is reported in this paper together with a study that compares this method to heuristic evaluation and user testing The study involved 73 novice evaluators and 25 end users, who evaluated an e learning application using one of the three techniques The comparison metric was defined along six major dimensions covering concepts of classical test theory and pragmatic aspects of usability evaluation The study showed that evaluation patterns capitalizing on the reuse of expert evaluators know how, provide a systematic framework which reduces reliance on individual skills, increases inter rater reliability and output standardization, permits the discovery of a larger set of different problems and decreases evaluation cost Results also indicated that evaluation in general is strongly dependent on the methodological apparatus as well as on judgement bias and individual preferences of evaluators, providing support to the conceptualisation of interactive quality as a subjective judgement, recently brought forward by the UX research agenda (C) 2010 Elsevier Ltd All rights reserved
Keyword:
Usability evaluation techniques
e Learning evaluation
Evaluation patterns
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
I
IF:
5.1
论文数:
2.8K
被引数:
8.9K
机构
引用论文
Current practice in measuring usability:: Challenges to usability studies and research当前测量可用性的实践: 可用性研究和研究面临的挑战
Effect of evaluators' cognitive style on heuristic evaluation: Field dependent and field independent evaluators评价者认知风格对启发式评价的影响: 场依赖与场独立评价者

