arrow
Return

Cognitive Validity: Can Multiple-Choice Items Tap Historical Thinking Processes?

delete2017-07-05
delete26
PRE
AI
M
Mark D. Smith *
DOI:10.3102/0002831217717949delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Cognitive validity examines the relationship between what an assessment aims to measure and what it actually elicits from test takers. The present study examined whether multiple-choice items from the National Assessment of Educational Progress (NAEP) grade 12 U.S. history exam elicited the historical thinking processes they were designed to measure. Think-aloud data from 27 accomplished high school students revealed that in no instances did students engage in the intended processes. Rather, the items typically elicited three construct-irrelevant processes: factual recall/recognition, reading comprehension, and test-taking strategies. Further, findings revealed that although the items often prompted students to engage in factual recall, they were often not sound indicators of student knowledge. Implications for history testing and alternative forms of assessment are discussed.
Keywords:
assessment
historical thinking
validity
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

American Educational Research Journal cover
American Educational Research Journal
IF:
3.6
Papers:
1.6K
Citations:
7.6K

Organization

S
Stanford University
Scholars:
9.6W
Papers: 8.2W
Citations: 17.0W