ERIC Number: ED560586
Record Type: Non-Journal
Publication Date: 2015-Jun
Pages: 8
Abstractor: As Provided
ISBN: N/A
ISSN: N/A
EISSN: N/A
Available Date: N/A
On the Performance Characteristics of Latent-Factor and Knowledge Tracing Models
Klingler, Severin; Käser, Tanja; Solenthaler, Barbara; Gross, Markus
International Educational Data Mining Society, Paper presented at the International Conference on Educational Data Mining (EDM) (8th, Madrid, Spain, Jun 26-29, 2015)
Modeling student knowledge is a fundamental task of an intelligent tutoring system. A popular approach for modeling the acquisition of knowledge is Bayesian Knowledge Tracing (BKT). Various extensions to the original BKT model have been proposed, among them two novel models that unify BKT and Item Response Theory (IRT). Latent Factor Knowledge Tracing (LFKT) and Feature Aware Student knowledge Tracing (FAST) exhibit state of the art prediction accuracy. However, only few studies have analyzed the characteristics of these different models. In this paper, we therefore evaluate and compare properties of the models using synthetic data sets. We sample from a combined student model that encompasses all four models. Based on the true parameters of the data generating process, we assess model performance characteristics for over 66'000 parameter configurations and identify best and worst case performance. Using regression we analyze the influence of different sampling parameters on the performance of the models and study their robustness under different model assumption violations. [For complete proceedings, see ED560503.]
Descriptors: Intelligent Tutoring Systems, Knowledge Level, Item Response Theory, Prediction, Comparative Analysis, Models, Performance, Regression (Statistics), Data Analysis, Probability, Simulation, Performance Factors, Error Patterns
International Educational Data Mining Society. e-mail: admin@educationaldatamining.org; Web site: http://www.educationaldatamining.org
Publication Type: Speeches/Meeting Papers; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: International Educational Data Mining Society
Grant or Contract Numbers: N/A
Author Affiliations: N/A