Internet-related issues have influenced how civic knowledge is educated and measured. The International Civic and Citizenship Education Study (ICCS) is a well-known large-scale assessment concerning how civic knowledge is educated and measured globally. Regardless of the emerging roles of internet access and usage, the influences of internet…

Introduction: This article aimed at digging deep into distractors used for mathematics multiple-choice items. The quality of distractors may be more important than their number and the stem in a multiple-choice question. Little attention is given to this aspect of item writing especially, mathematics multiple-choice questions. This article…

Multiple choice results are inherently probabilistic outcomes, as correct responses reflect a combination of knowledge and guessing, while incorrect responses additionally reflect blunder, a confidently committed mistake. To objectively resolve knowledge from responses in an MC test structure, we evaluated probabilistic models that explicitly…

Several recent studies have employed item response theory (IRT) to rank incorrect responses to commonly used research-based multiple-choice assessments. These studies use Bock's nominal response model (NRM) for applying IRT to categorical (nondichotomous) data, but the response rankings only utilize half of the parameters estimated by the model.…

Item response theory (IRT) is a popular method to infer student abilities and item difficulties from observed test responses. However, IRT struggles with two challenges: How to map items to skills if multiple skills are present? And how to infer the ability of new students that have not been part of the training data? Inspired by recent advances…

Student engagement in large Life Sciences classes can be problematic, especially with the course work done outside formal class contact hours. To enhance student engagement with the content outside class time, we designed an assignment spanning one semester that required students to author MCQs. We used Bloom's taxonomy to evaluate the MCQs.…

Background: Poor mathematics performance in South Africa is well known. The COVID-19 pandemic was expected to exacerbate the situation. Aim: To investigate Grade 7 learners' mathematical knowledge at the end of primary school and to compare mathematical performance of Grade 7 and 8 learners in the context of the pandemic. Setting: Data were…

The aim of the study was to determine whether there is a relationship between students' answers to geography questions framed according to the factual and conceptual levels of the knowledge dimension of the Revised Bloom's Taxonomy. The study used a correlational survey design. The data were gleaned from the answers that 52 students studying…

Multiple-choice items are used in large-scale assessments of mathematical achievement for secondary students in many countries. Research findings can be implemented to improve the quality of the items and hence increase the amount of information gathered about student learning from each item. One way to achieve this is to create items for which…

Intelligent tutoring systems (ITS), like human tutors, try to adapt to student's knowledge level so that the instruction is tailored to their needs. One aspect of this adaptation relies on the ability to have an understanding of the student's initial knowledge so as to build on it, avoiding teaching what the student already knows and focusing on…

This study tests a hypothesized learning progression for the concept of energy. It looks at 14 specific ideas under the categories of (i) Energy Forms and Transformations; (ii) Energy Transfer; (iii) Energy Dissipation and Degradation; and (iv) Energy Conservation. It then examines students' growth of understanding within each of these ideas at…

This study tests a hypothesized learning progression for the concept of energy. It looks at 14 specific ideas under the categories of (i) Energy Forms and Transformations; (ii) Energy Transfer; (iii) Energy Dissipation and Degradation; and (iv) Energy Conservation. It then examines students' growth of understanding within each of these ideas at…

The basis for understanding neurophysiology is understanding ion movement across cell membranes. Students in introductory courses recognize ion concentration gradients as a driving force for ion movement but struggle to simultaneously account for electrical charge gradients. We developed a 17-multiple-choice item assessment of students'…

Electronic testing has become a regular part of online courses. Most learning management systems offer a wide range of tools that can be used in electronic tests. With respect to time demands, the most efficient tools are those that allow automatic assessment. The presented paper focuses on one of these tools: matching questions in which one…

The combination of different item formats is found quite often in large scale assessments, and analyses on the dimensionality often indicate multi-dimensionality of tests regarding the task format. In ICILS 2013, three different item types (information-based response tasks, simulation tasks, and authoring tasks) were used to measure computer and…