arrow
Return

Demand characteristics in human-computer experiments

delete2025-01-01
delete0
delete
OA
AI
O
Olga Iarygina *
K
Kasper Hornbæk
A
Aske Mottelson
DOI:10.1016/j.ijhcs.2024.103379delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Demand characteristics refer to cues that can inform participants in experiments about the hypothesis and influence their behavior. They lead researchers to erroneously infer non-existing effects, undermining the experimental integrity of empirical studies. Despite a widespread acknowledgment of their confounding influence in experimental psychology, experiments involving humans and computers to a lesser extent consider effects of demand characteristics, as computerized protocols are thought to be immune to some experimenter biases. Furthermore, demand characteristics are considered to mainly effect subjective measures. As a result, demand characteristics often remain uncontrolled in studies involving computers, and in particular for objective measures such as performance. In this paper, we present two experiments that underline the importance of demand characteristics in human-computer interaction experiments. In a text-entry study, we made participants believe they were evaluating a research-based keyboard. This belief led to increased performance and self-reported user experience. In a second study, we conducted a thought experiment on the illusion of body ownership in virtual reality, where the experimental design indicated the study hypothesis. We found hypothesis-compliant responses from participants, even when they did not experience the illusion. We conclude that demand characteristics pose a significant challenge to the interpretation and validity of human-computer experiments, even when they are fully automated. We discuss the implications and offer guidelines to mitigate effects of demand characteristics.
Keywords:
Demand characteristics
Experiments
Confounds
Bias
Validity
Human-computer interaction
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

I
International Journal of Human-Computer Studies
IF:
5.1
Papers:
2.8K
Citations:
8.9K

Organization

U
University of Copenhagen
Scholars:
7.6W
Papers: 6.6W
Citations: 86
I
IT University Copenhagen
Scholars:
353
Papers: 345
Citations: 13