ERIC Number: ED537207
Record Type: Non-Journal
Publication Date: 2012-Jun
Pages: 8
Abstractor: As Provided
ISBN: N/A
ISSN: N/A
EISSN: N/A
Available Date: N/A
Comparison of Methods to Trace Multiple Subskills: Is LR-DBN Best?
Xu, Yanbo; Mostow, Jack
International Educational Data Mining Society, Paper presented at the International Conference on Educational Data Mining (EDM) (5th, Chania, Greece, Jun 19-21, 2012)
A long-standing challenge for knowledge tracing is how to update estimates of multiple subskills that underlie a single observable step. We characterize approaches to this problem by how they model knowledge tracing, fit its parameters, predict performance, and update subskill estimates. Previous methods allocated blame or credit among subskills in various ways based on strong assumptions about their relation to observed performance. LR-DBN relaxes these assumptions by using logistic regression in a Dynamic Bayes Net. LR-DBN significantly outperforms previous methods on data sets from reading and algebra tutors in terms of predictive accuracy on unseen data, cutting the error rate by half. An ablation experiment shows that using logistic regression to predict performance helps, but that using it to jointly estimate subskills explains most of this dramatic improvement. An implementation of LR-DBN is now publicly available in the BNT-SM student modeling toolkit. Instruction to use LR-DBN in BNT-SM is appended. (Contains 2 figures, 7 tables, and 2 footnotes.) [For the complete proceedings, "Proceedings of the International Conference on Educational Data Mining (EDM) (5th, Channa, Greece, June 19-21, 2012)," see ED537074.]
Descriptors: Teaching Methods, Comparative Analysis, Prediction, Mathematics, Algebra, Tutors, Regression (Statistics), Bayesian Statistics, Probability, Models
International Educational Data Mining Society. e-mail: admin@educationaldatamining.org; Web site: http://www.educationaldatamining.org
Publication Type: Reports - Evaluative; Speeches/Meeting Papers
Education Level: N/A
Audience: N/A
Language: English
Sponsor: Institute of Education Sciences (ED)
Authoring Institution: International Educational Data Mining Society
Grant or Contract Numbers: N/A
Author Affiliations: N/A