While formative assessment is a widely valued instructional approach to support meaningful learning, putting it into classroom practice remains a challenge, also because the time resources required may conflict with other goals. In a cluster-randomized controlled intervention study with 29 teachers and 604 students (mean age 15.6 years) at…

There is a pressing need to bridge the theoretical discussions and emerging empirical evidence of the benefits of culturally relevant, responsive, and sustaining assessments with the reality of its operational implementation. This paper details our efforts to operationalize culturally sustaining (CS) content development for a high-stakes,…

Natural selection is a fundamental scientific process, yet students and educators alike demonstrate misconceptions of the process. Though images are used often in science to facilitate learning, it is less common to assess learners' understanding through their own drawings. This study utilizes a multiple-choice assessment of evolutionary processes…

Preservice elementary teachers (PSTs) prepare for various standardized assessments, such as the Praxis® licensure assessment. However, there is little research on test-taking behavior and test-taking strategies for this examinee population. A common belief and instruction given in some test preparation materials is that examinees should stick to…

This study fit a Naïve Bayesian classifier to the words of exam items to predict the Bloom's taxonomy level of the items. We addressed five research questions, showing that reasonably good prediction of Bloom's level was possible, but accuracy varies across levels. In our study, performance for Level 2 was poor (Level 2 items were misclassified…

In a concept learning scenario, any technology-supported learning system must provide students with mechanisms that help them with the acquisition of the concepts to be learned. For the technology-supported learning systems to be successful in this task, the development of didactic material is crucial--a hard task that could be alleviated by means…

Cognitive psychologists have found that taking practice tests improves students' learning, and some claim that tests that require recall are more effective than those that require recognition. This study examined whether recognition (i.e., multiple-choice) quizzes were as effective as cued-recall (i.e., fill-in-the-blank) quizzes for improving…

In the present study, we recorded the eye movements of 20 criterion-based selected trainee teachers in economics while they responded to 25 single choice (SC) items in an economic content knowledge (CK) test and rated their confidence for each response in a digital assessment. By using a multilevel modeling approach with crossed random effects, we…

Disengaged responding poses a severe threat to the validity of educational large-scale assessments, because item responses from unmotivated test-takers do not reflect their actual ability. Existing identification approaches rely primarily on item response times, which bears the risk of misclassifying fast engaged or slow disengaged responses.…

Providing students with feedback on their performance is a critical part of enhancing student learning in chemistry and is often integrated into homework assignments, quizzes, and exams. However, not all feedback is created equal, and the type of feedback the student receives can dramatically alter the utility of the feedback to reinforce correct…

Research has suggested that changing one's answer on multiple-choice examinations is more likely to lead to positive academic outcomes. This study aimed to further understand the relationship between changing answer selections and item attributes, student performance, and time within a population of 158 first-year medical students enrolled in a…

Students' digital technology literacy is required to develop technology-based teaching skills as prospective teachers. Therefore, students' digital technology literacy profiles must be known as a basis for learning policies. This research aims to describe the digital technology literacy profile of students as prospective elementary school…

Multidimensional forced-choice (MFC) items have been found to be useful to reduce response biases in personality assessments. However, conventional scoring methods for the MFC items result in ipsative data, hindering the wider applications of the MFC format. In the last decade, a number of item response theory (IRT) models have been developed,…

Most biology undergraduates learn about mutations in multiple classrooms throughout their college career. Understanding personalised genome test results, genome editing controversies, and the appearance of new variants of viruses or antibiotic resistant bacteria all require foundational knowledge about mutations. However, the abstract nature of…

Game-based learning environments hold significant promise for facilitating learning experiences that are both effective and engaging. To support individualised learning and support proactive scaffolding when students are struggling, game-based learning environments should be able to accurately predict student knowledge at early points in students'…