Abstract:Large language models (LLMs) are promising tools for scaffolding students’ English writing skills, but their effectiveness in real-time K-12 classrooms remains underexplored. Addressing this gap, our study examines the benefits and limitations of using LLMs as real-time learning support, considering how classroom constraints, such as diverse proficiency levels and limited time, affect their effectiveness. We conducted a deployment study with 157 eighth-grade students in a South Korean middle school English class over six weeks. Our findings reveal that while scaffolding improved students’ ability to compose grammatically correct sentences, this step-by-step approach demotivated lower-proficiency students and increased their syst…
Abstract:Large language models (LLMs) are promising tools for scaffolding students’ English writing skills, but their effectiveness in real-time K-12 classrooms remains underexplored. Addressing this gap, our study examines the benefits and limitations of using LLMs as real-time learning support, considering how classroom constraints, such as diverse proficiency levels and limited time, affect their effectiveness. We conducted a deployment study with 157 eighth-grade students in a South Korean middle school English class over six weeks. Our findings reveal that while scaffolding improved students’ ability to compose grammatically correct sentences, this step-by-step approach demotivated lower-proficiency students and increased their system reliance. We also observed challenges to classroom dynamics, where extroverted students often dominated the teacher’s attention, and the system’s assistance made it difficult for teachers to identify struggling students. Based on these findings, we discuss design guidelines for integrating LLMs into real-time writing classes as inclusive educational tools.
| Comments: | Under Review |
| Subjects: | Human-Computer Interaction (cs.HC) |
| Cite as: | arXiv:2512.05506 [cs.HC] |
| (or arXiv:2512.05506v1 [cs.HC] for this version) | |
| https://doi.org/10.48550/arXiv.2512.05506 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Junho Myung [view email] [v1] Fri, 5 Dec 2025 08:09:05 UTC (2,278 KB)