.png){kind=icon}
返回
Exploring how feedback reflects entrustment decisions using artificial intelligence
.png){kind=icon}
PRE
AI
DOI：10.1111/medu.14696.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Context: Clinical supervisors make judgements about how much to trust learners with critical activities in patient care. Such decisions mediate trainees' opportunities for learning and competency development and thus are a critical component of education. As educators apply entrustment frameworks to assessment, it is important to determine how narrative feedback reflecting entrustment may also address learners' educational needs. Methods: In this study, we used artificial intelligence (AI) and natural language processing (NLP) to identify characteristics of feedback tied to supervisors' entrustment decisions during direct observation encounters of clerkship medical students (3328 unique observations). Supervisors conducted observations of students and collaborated with them to complete an entrustment-based assessment in which they documented narrative feedback and assigned an entrustment rating. We trained a deep neural network (DNN) to predict entrustment levels from the narrative data and developed an explainable AI protocol to uncover the latent thematic features the DNN used to make its prediction. Results: We found that entrustment levels were associated with level of detail (specific steps for performing clinical tasks), feedback type (constructive versus reinforcing) and task type (procedural versus cognitive). In justifying both high and low levels of entrustment, supervisors detailed concrete steps that trainees performed (or did not yet perform) competently. Conclusions: Framing our results in the factors previously identified as influencing entrustment, we find a focus on performance details related to trainees' clinical competency as opposed to nonspecific feedback on trainee qualities. The entrustment framework reflected in feedback appeared to guide specific goal-setting, combined with details necessary to reach those goals. Our NLP methodology can also serve as a starting point for future work on entrustment and feedback as similar assessment datasets accumulate.
Keyword:
EDUCATIONAL ALLIANCE
DEVELOP TRUST
CLASSIFICATION
PERCEPTIONS
COMPETENCE
PSYCHOLOGY
RESIDENTS
TRAINEES
STUDENTS
SURGERY
期刊
IF:
5.2
论文数:
8.3K
被引数:
1.3W
机构
引用论文
Particle Shedding from Cotton and Cotton-Polyester Fabrics in the Dry State and in Washes.png)
Polymers
OAAI
PolymersIF0
OAAI分享收藏Supporting Learners' Agentic Engagement With Feedback: A Systematic Review and a Taxonomy of Recipience Processes通过反馈支持学习者的代理参与: 系统回顾和接受过程的分类EDUCATIONAL PSYCHOLOGIST
OAAI
EDUCATIONAL PSYCHOLOGISTIF11.4
OAAI分享收藏How Residents Develop Trust in Interns: A Multi-Institutional Mixed-Methods StudyACADEMIC MEDICINEOAAI
ACADEMIC MEDICINEIF5.2
OAAI分享收藏An argument-based approach to the validation of UHTRUST: can we measure how recent graduates can be trusted with unfamiliar tasks?一种基于论证的方法来验证UHTRUST: 我们能否衡量应届毕业生在不熟悉的任务中可以信任的程度？
PREAI
分享收藏
查看更多内容