arrow
Return

Pacing for Mastery: Optimizing LLM Interactions for Learning

delete2026-01-01
delete0
PRE
AI
K
Karena Tran *
G
Ge Gao
A
Angela Lombard
T
T.C.B. Yu
H
Haoning Jiang
T
Thomas Y. Yeh
DOI:10.1145/3770762.3772501delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Large Language Models (LLMs) hold significant potential for transforming computer science education, yet concerns over their possible negative effects on student learning and retention have slowed broader instructor adoption. Evidence on LLM use is mixed. While novices may benefit from the generative capabilities of AI, they also risk developing overreliance. To address these concerns, we investigate how the pace of interaction with AI assistants affects learning in introductory CS courses by deploying three AI assistants (Fast, Medium, and Slow) in a classroom setting. Our results show that the slower-paced, Socratic-style AI assistant significantly increases learning, especially for students with less prior knowledge. Although faster-paced interaction benefits more advanced students initially, learning retention degrades enough to negate those gains. Surprisingly, the medium-paced assistant with typical instructor preprompt elements shows no statistically significant improvements. Given that students may use fast-paced commercial AI tools for coursework regardless of policy, offering a slower-paced, Socratic-style AI alternative could meaningfully improve overall student learning outcomes.
Keywords:
interaction pace
learning
retention
novice programmers
CS1
LLMs
Generative AI
AI assistants
classroom

Journal

P
PROCEEDINGS OF THE 57TH ACM TECHNICAL SYMPOSIUM ON COMPUTER SCIENCE EDUCATION V.1, SIGCSE TS 2026
IF:
0
Papers:
170
Citations:
0

Organization

University of California System cover
University of California System
Scholars:
37.7W
Papers: 33.8W
Citations: 6.6K
Cited Papers

Cited Papers

Math Education with Large Language Models: Peril or Promise?
err2023-01-01
err0
PREAI
errHarsh Kumar; David M. Rothschild; Daniel G. Goldstein; Jake Hofman
errShare
errSave
Thinking in Education
err
IF0
err2012-06-05
err0
PREAI
errMatthew Lipman
errShare
errSave
errShare
errSave
The Robots Are Here: Navigating the Generative AI Revolution in Computing Education
err2023-12-28
err0
errOAAI
errJames Prather; Paul Denny; Juho Leinonen; Brett A. Becker; Ibrahim Albluwi; Michelle Craig; Hieke Keuning; Natalie Kiesler; Tobias Kohn; Andrew Luxton-Reilly; Stephen MacNeil; Andrew Petersen; Raymond Pettit; Brent N. Reeves; Jaromir Savelka
errShare
errSave
err
IF0
err
err0
PREAI
err
errShare
errSave
Improving AI in CS50: Leveraging Human Feedback for Better Learning
err2025-02-12
err0
PREAI
errLiu,Rongxin; Zhao,Julianna; Xu,Benjamin; Perez,Christopher; Zhukovets,Yuliia; Malan,David J.
errShare
errSave
How Beginning Programmers and Code LLMs (Mis)read Each Other
err2024-05-11
err0
errOAAI
errSydney Nguyen; Hannah McLean Babe; Yangtian Zi; Arjun Guha; Carolyn Jane Anderson; Molly Q Feldman
errShare
errSave
researcher View more