ERIC Number: ED624168
Record Type: Non-Journal
Publication Date: 2022
Pages: 7
Abstractor: As Provided
ISBN: N/A
ISSN: N/A
EISSN: N/A
Available Date: N/A
Using a Randomized Experiment to Compare the Performance of Two Adaptive Assessment Engines
Matayoshi, Jeffrey; Uzun, Hasan; Cosyn, Eric
International Educational Data Mining Society, Paper presented at the International Conference on Educational Data Mining (EDM) (15th, Durham, United Kingdom, Jul 24-27, 2022)
Knowledge space theory (KST) is a mathematical framework for modeling and assessing student knowledge. While KST has successfully served as the foundation of several learning systems, recent advancements in machine learning provide an opportunity to improve on purely KST-based approaches to assessing student knowledge. As such, in this work we compare the performance of an existing KST-based adaptive assessment to that of a newly developed version--with this new version combining the predictive power of a neural network model with the strengths of existing KST-based approaches. Using a cluster randomized experiment containing data from approximately 140,000 assessments, we show that the new neural network assessment engine improves on the performance of the existing KST version, both on standard classification metrics, as well as on measures more specific to the student learning experience. [For the full proceedings, see ED623995.]
Descriptors: Knowledge Level, Mathematical Models, Learning Experience, Comparative Analysis, Learning Management Systems, Classification, Artificial Intelligence, Student Evaluation, Computer Assisted Testing, Middle School Students, Chemistry, Science Projects, Undergraduate Students, Algebra, Science Achievement, Mathematics Achievement, Recall (Psychology), Accuracy
International Educational Data Mining Society. e-mail: admin@educationaldatamining.org; Web site: https://educationaldatamining.org/conferences/
Publication Type: Speeches/Meeting Papers; Reports - Research
Education Level: Junior High Schools; Middle Schools; Secondary Education; Higher Education; Postsecondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Author Affiliations: N/A