arrow
Return

Comparative Structured Observation

delete2025-01-09
delete0
PRE
AI
W
Wendy E. Mackay
J
Joanna McGrenere
DOI:10.1145/3711838delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Although HCI researchers often generate and compare new design concepts, they lack an established method for rigorously conducting qualitative assessments. We define and characterize Comparative Structured Observation as a qualitative research method that takes advantage of the structure of controlled experiments to generate comparable, ecologically relevant experiences with two or more design variants, often implemented as mediumfidelity prototypes. Researchers observe users and ask them to compare and reflect on each variant. We identify criteria for creating a successful Comparative Structured Observation study and illustrate variations of the method by analyzing four published studies. We also examine six additional studies (three near and three far) to clarify the boundary between what should and should not be considered a Comparative Structured Observation. We discuss the benefits and limitations of the method and argue that gathering comparative reflections about design variants can help researchers assess and advance their design concepts.
Keywords:
Comparative Structured Observation
Design methodology
Interventionist
Mixed-methods
Qualitative methods
Quantitative methods
Research methodology

Journal

ACM Transactions on Computer-Human Interaction cover
ACM Transactions on Computer-Human Interaction
IF:
6.6
Papers:
64
Citations:
3.9K

Organization

I
Inria
Scholars:
3.5K
Papers: 2.5K
Citations: 343
U
Univ British Columbia
Scholars:
2.5K
Papers: 1.9K
Citations: 516