Title:Extracting Causal Relations in Deep Knowledge Tracing
Abstract:A longstanding goal in computational educational research is to develop explainable knowledge tracing (KT) models. Deep Knowledge Tracing (DKT), which leverages a Recurrent Neural Network (RNN) to predict student knowledge and performance on exercises, has been proposed as a major advancement over traditional KT methods. Several studies suggest that its performance gains stem from its ability to model bidirectional relationships between different knowledge components (KCs) within a course, enabling the inference of a student’s understanding of one KC from their performance on others. In this paper, w…
Title:Extracting Causal Relations in Deep Knowledge Tracing
Abstract:A longstanding goal in computational educational research is to develop explainable knowledge tracing (KT) models. Deep Knowledge Tracing (DKT), which leverages a Recurrent Neural Network (RNN) to predict student knowledge and performance on exercises, has been proposed as a major advancement over traditional KT methods. Several studies suggest that its performance gains stem from its ability to model bidirectional relationships between different knowledge components (KCs) within a course, enabling the inference of a student’s understanding of one KC from their performance on others. In this paper, we challenge this prevailing explanation and demonstrate that DKT’s strength lies in its implicit ability to model prerequisite relationships as a causal structure, rather than bidirectional relationships. By pruning exercise relation graphs into Directed Acyclic Graphs (DAGs) and training DKT on causal subsets of the Assistments dataset, we show that DKT’s predictive capabilities align strongly with these causal structures. Furthermore, we propose an alternative method for extracting exercise relation DAGs using DKT’s learned representations and provide empirical evidence supporting our claim. Our findings suggest that DKT’s effectiveness is largely driven by its capacity to approximate causal dependencies between KCs rather than simple relational mappings.
| Comments: | Accepted for publication in the Proceedings of the 18th International Conference on Educational Data Mining, 6 pages, 1 figure |
| Subjects: | Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC) |
| ACM classes: | I.2.6; K.3.1 |
| Cite as: | arXiv:2511.03948 [cs.AI] |
| (or arXiv:2511.03948v1 [cs.AI] for this version) | |
| https://doi.org/10.48550/arXiv.2511.03948 arXiv-issued DOI via DataCite (pending registration) | |
| Journal reference: | Proceedings of the 18th International Conference on Educational Data Mining, 586–591 |
| Related DOI: | https://doi.org/10.5281/zenodo.15870217 DOI(s) linking to related resources |
Submission history
From: Kevin Hong [view email] [v1] Thu, 6 Nov 2025 00:52:28 UTC (111 KB)