返回
Group Assessments of Resident Physicians Improve Reliability and Decrease Halo Error
DOI:10.1007/s11606-011-1670-4.png)
摘要
En 中文
BACKGROUND: Individual faculty assessments of resident competency are complicated by inconsistent application of standards, lack of reliability, and the halo effect. OBJECTIVE: We determined whether the addition of faculty group assessments of residents in an ambulatory clinic, compared with individual faculty-of-resident assessments alone, have better reliability and reduced halo effects. DESIGN: This prospective, longitudinal study was performed in the outpatient continuity clinics of a large internal medicine residency program. MAIN MEASURES: Faculty-on-resident and group faculty-on-resident assessment scores were used for comparison. KEY RESULTS: Overall mean scores were significantly higher for group than individual assessments (3.92 +/- 0.51 vs. 3.83 +/- 0.38, p = 0.0001). Overall inter-rater reliability increased when combining group and individual assessments compared to individual assessments alone (intraclass correlation coefficient, 95% CI = 0.828, 0.785-0.866 vs. 0.749, 0.686-0.804). Inter-item correlations were less for group (0.49) than individual (0.68) assessments. CONCLUSIONS: This study demonstrates improved inter-rater reliability and reduced range restriction (halo effect) of resident assessment across multiple performance domains by adding the group assessment method to traditional individual faculty-on-resident assessment. This feasible model could help graduate medical education programs achieve more reliable and discriminating resident assessments.
Keyword:
graduate medical education
professional competence
educational measurement
formal evaluation sessions
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
4.2
论文数:
1.3W
被引数:
3.2W
机构
引用论文
The effectiveness of formal evaluation sessions during clinical clerkships in better identifying students with marginal funds of knowledge
ACADEMIC MEDICINE
IF5.2
Do global rating forms enable program directors to assess the ACGME competencies?
ACADEMIC MEDICINE
IF5.2
Do individual attendings' post-rotation performance ratings detect residents' clinical performance deficiencies
ACADEMIC MEDICINE
IF5.2
Assessing the effectiveness of combining evaluation methods for the early identification of students with inadequate knowledge during a clerkship
MEDICAL TEACHER
IF4.4

