ERIC Number: EJ1267377
Record Type: Journal
Publication Date: 2020
Pages: 14
Abstractor: As Provided
ISBN: N/A
ISSN: EISSN-1309-517X
EISSN: N/A
Available Date: N/A
Identification of Cognitive Learning Complexity of Assessment Questions Using Multi-Class Text Classification
Contemporary Educational Technology, v12 n2 Article ep275 2020
Cognitive learning complexity identification of assessment questions is an essential task in the domain of education, as it helps both the teacher and the learner to discover the thinking process required to answer a given question. Bloom's Taxonomy cognitive levels are considered as a benchmark standard for the classification of cognitive thinking (learning complexity) in an educational environment. However, it was observed that some of the action verbs of Bloom's Taxonomy are overlapping in multiple levels of the hierarchy, causing ambiguity about the real sense of cognition required. The paper describes two methodologies to automatically identify the cognitive learning complexity of given questions. The first methodology uses labelled Latent Dirichlet Allocation (LDA) as a machine learning approach. The second methodology uses the BERT framework for multi-class text classification for deep learning. The experiments were performed on an ensemble of 3000+ educational questions, which were based on previously published datasets along with the TREC question corpus and AI2 Biology How/Why question corpus datasets. The labelled LDA reached an accuracy of 83% while BERT based approach reached 89% accuracy. An analysis of both the results is shown, evaluating the significant factors responsible for determining cognitive knowledge.
Descriptors: Classification, Difficulty Level, Test Items, Identification, Cognitive Processes, Automation, Accuracy, Artificial Intelligence
Contemporary Educational Technology. Faculty of Communication Sciences, Anadolu University, Yunus Emre Campus, Eskisehir 26470, Turkey. e-mail: editor@cedtech.net; Web site: http://www.cedtech.net
Publication Type: Journal Articles; Reports - Evaluative
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Author Affiliations: N/A