ERIC Number: EJ1386414
Record Type: Journal
Publication Date: 2022
Pages: 19
Abstractor: As Provided
ISBN: N/A
ISSN: N/A
EISSN: EISSN-2375-5636
Available Date: N/A
Using Machine Learning to Predict Bloom's Taxonomy Level for Certification Exam Items
Mead, Alan D.; Zhou, Chenxuan
Journal of Applied Testing Technology, v23 spec iss 1 p53-71 2022
This study fit a Naïve Bayesian classifier to the words of exam items to predict the Bloom's taxonomy level of the items. We addressed five research questions, showing that reasonably good prediction of Bloom's level was possible, but accuracy varies across levels. In our study, performance for Level 2 was poor (Level 2 items were misclassified and other items were classified as Level 2), but the performance of the model in distinguishing Level 1 from all other levels was quite good. Applying a model developed on an IT certification exam domain to a more diverse set of items showed poor performance, suggesting that models may generalize poorly. Finally, we showed what features of items the classifier was using. Examples and implications for practice are discussed.
Descriptors: Artificial Intelligence, Prediction, Taxonomy, Natural Language Processing, Test Items, Accuracy, Information Technology, Certification, Bayesian Statistics, Models, Multiple Choice Tests
Association of Test Publishers. 601 Pennsylvania Avenue NW, South Building Suite 900, Washington DC 20004. Tel: 866-240-7909; Fax: 717-755-8962; e-mail: wgh.atp@att.net; Web site: https://jattjournal.net/index.php/atp/index
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Author Affiliations: N/A