Item response theory (IRT) is a popular method to infer student abilities and item difficulties from observed test responses. However, IRT struggles with two challenges: How to map items to skills if multiple skills are present? And how to infer the ability of new students that have not been part of the training data? Inspired by recent advances…

Background: In countries that endorse science, technology, engineering, and mathematics (STEM) education as an educational movement, design-based learning is deemed a pedagogical approach. Purpose: Because the integration of the engineering design process and scientific investigation has been an issue in science education, this study examined the…

A new teaching format, the LecturePlus, was formulated as a lecture followed by small-group learning activities. This study assessed the effectiveness of LecturePlus in medical education. An interventional study was conducted among final-year medical students, with 74 students in the experimental group and 96 students in the control group. Each…

Readers often struggle to identify the main ideas in expository texts. Existing research and instruction provide some guidance on how to encourage readers to identify main ideas. However, there is substantial variability in how main ideas are operationalized and how readers are prompted to identify main ideas. This variability hinders…

Whether visual information belongs in second language (L2) listening tests has long been a subject for scholarly debate, with L2 learners' performance on and perceptions of video-based tests being the primary sources of evidence. The research into L2 teachers' perceptions, however, is scarce, as is the research into stakeholders' views of content…

The New York State Education Department (NYSED) has a partnership with NWEA for the development of the 2024 Grades 3-8 English Language Arts Tests. Teachers from across the State work with NYSED in a variety of activities to ensure the validity and reliability of the New York State Testing Program (NYSTP). The 2024 Grades 6 and 7 English Language…

Educational videos are becoming more prevalent within a higher education context and the use of videos is now taken for granted. However, the full impact videos have on learning is under researched and not fully known. This study was conducted to investigate the effectiveness of quiz questions embedded throughout a video. Students from different…

This article presents a novel experimental methodology in which groups of students were offered the option to choose between two equivalent scoring rules to assess a multiple-choice test. The effect of choosing the scoring rule on marks is tested. Two major contributions arise from this research. First, it contributes to the literature on the…

Due to their test economy and objective evaluability, multiple-choice items are used much more frequently to test knowledge than constructed-response questions. However, studies point out that dependencies may exist between the individual test result and the test format (multiple-choice or constructed-response). Studies testing economic knowledge…

One of the most important goals in E-learning is to guarantee that participants reach the learning objectives. We have observed that having the knowledge of the subject is not sufficient for reaching learning objectives. The participants must also develop understanding that they know the subject, which we have named confidence. In this work, we…

Assessment plays an important role in learning and Multiple Choice Questions (MCQs) are quite popular in large-scale evaluations. Technology-enabled learning necessitates a smart assessment. Therefore, automatic MCQ generation became increasingly popular in the last two decades. Despite a large amount of research effort, system generated MCQs are…

Single-best answers to multiple-choice items are commonly dichotomized into correct and incorrect responses, and modeled using either a dichotomous item response theory (IRT) model or a polytomous one if differences among all response options are to be retained. The current study presents an alternative IRT-based modeling approach to…

Training programs, in industry, are a common way to increase awareness and change the behavior of individuals. The most popular way to determine the effectiveness of the training on learning outcomes is to administer assessments with Multiple Choice Questions (MCQ) to the participants, despite the fact that in this type of assessment it is…

In any science field, including physics, it is important to remain abreast of new assessment methods to cater to the 21st-century student. The rationale of this paper is to argue for a move away from the use of lower-order thinking skills (LOTS) in e-assessment in favor of higher-order thinking skills (HOTS), in line with Bloom's Revised Taxonomy.…

This study explored the impact of homogeneity of answer choices on item difficulty and discrimination. Twenty-two matched pairs of elementary and secondary mathematics items were administered to randomly equivalent samples of students. Each item pair comparison was treated as a separate study with the set of effect sizes analyzed using…