arrow
Return

Leveraging Large Language Models to Generate Course-Specific Semantically Annotated Learning Objects

delete2024-12-23
delete0
delete
OA
AI
D
Dominic Lohr *
M
Marc Berges
A
Abhishek Chugh
M
Michael Kohlhase
D
Dennis Müller
DOI:10.1111/jcal.13101delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
BackgroundOver the past few decades, the process and methodology of automatic question generation (AQG) have undergone significant transformations. Recent progress in generative natural language models has opened up new potential in the generation of educational content.ObjectivesThis paper explores the potential of large language models (LLMs) for generating computer science questions that are sufficiently annotated for automatic learner model updates, are fully situated in the context of a particular course and address the cognitive dimension understand.MethodsUnlike previous attempts that might use basic methods such as ChatGPT, our approach involves more targeted strategies such as retrieval-augmented generation (RAG) to produce contextually relevant and pedagogically meaningful learning objects.Results and ConclusionsOur results show that generating structural, semantic annotations works well. However, this success was not reflected in the case of relational annotations. The quality of the generated questions often did not meet educational standards, highlighting that although LLMs can contribute to the pool of learning materials, their current level of performance requires significant human intervention to refine and validate the generated content.
Keywords:
automatic question generation
computer science
generative AI
GPT-4
large language models
retrieval-augmented generation

Journal

Computer Assisted Language Learning cover
Computer Assisted Language Learning
IF:
6.6
Papers:
3.0K
Citations:
5.2K

Organization

No organization information available
Cited Papers

Cited Papers

err
IF0
err
err0
PREAI
err
errShare
errSave
Demographic, psychosocial, and contextual correlates of tobacco use in sexual minority women
err2011-02-08
err0
PREAI
errAlicia K. Matthews; Anna Hotton; Steve DuBois; David Fingerhut; Lisa M. Kuhns
errShare
errSave
Cognitive architecture and instructional design
err1998-01-01
err4.1K
PREAI
errSweller, J; van Merrienboer, JJG; Paas, FGWC
errShare
errSave
Factors associated with postpartum depression among women in Vientiane Capital, Lao People’s Democratic Republic: A cross-sectional study
err2020-12-04
err0
errOAAI
errSouphalak Inthaphatha; Eiko Yamamoto; Viengsakhone Louangpradith; Yuki Takahashi; Alongkone Phengsavanh; Tetsuyoshi Kariya; Yu Mon Saw; Nobuyuki Hamajima
errShare
errSave
researcher View more