Abstract:This paper presents a psychologically-aware conversational agent designed to enhance both learning performance and emotional well-being in educational settings. The system combines Large Language Models (LLMs), a knowledge graph-enhanced BERT (KG-BERT), and a bidirectional Long Short-Term Memory (LSTM) with attention to classify students’ cognitive and affective states in real time. Unlike prior chatbots limited to either tutoring or affective support, our approach leverages multimodal data-including textual semantics, prosodic speech features, and temporal behavioral trends-to infer engagement, stress, and conceptual understanding. A pilot study with university st…
Abstract:This paper presents a psychologically-aware conversational agent designed to enhance both learning performance and emotional well-being in educational settings. The system combines Large Language Models (LLMs), a knowledge graph-enhanced BERT (KG-BERT), and a bidirectional Long Short-Term Memory (LSTM) with attention to classify students’ cognitive and affective states in real time. Unlike prior chatbots limited to either tutoring or affective support, our approach leverages multimodal data-including textual semantics, prosodic speech features, and temporal behavioral trends-to infer engagement, stress, and conceptual understanding. A pilot study with university students demonstrated improved motivation, reduced stress, and moderate academic gains compared to baseline methods. These results underline the promise of integrating semantic reasoning, multimodal fusion, and temporal modeling to support adaptive, student-centered educational interventions.
| Comments: | This manuscript is currently under peer review in Expert Systems with Applications |
| Subjects: | Computation and Language (cs.CL) |
| Cite as: | arXiv:2512.10441 [cs.CL] |
| (or arXiv:2512.10441v1 [cs.CL] for this version) | |
| https://doi.org/10.48550/arXiv.2512.10441 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Nour El Houda Ben Chaabene [view email] [v1] Thu, 11 Dec 2025 09:06:45 UTC (3,204 KB)