Multiple choice questions (MCQs) are commonly used for assessing students, but medical teachers may lack training in writing them. MCQs often have imperfections called item-writing flaws (IWFs) that can affect students' results and impede objective evaluation of their knowledge. This study aimed to evaluate a guideline-based faculty development…

Answering the call for response process-based validation, this study shows how researchers can evaluate validity evidence of test scores based on the mental "processes" test-takers use, rather than based on correlations with other "outcome" measures. The proposed methods for process-based validation studies are demonstrated…

This study addresses equating issues with varying sample sizes using the Rasch model by examining how sample size affects the stability of item calibrations and person ability estimates. A resampling design was used to create 9 sample size conditions (200, 100, 50, 45, 40, 35, 30, 25, and 20), each replicated 10 times. Items were recalibrated…

Brewe, Bruun, and Bearden first applied network analysis to understand patterns of incorrect conceptual physics reasoning in multiple-choice instruments introducing the module analysis for multiple-choice responses (MAMCR) algorithm. Wells et al. proposed an extension to the algorithm which allowed the analysis of large datasets called modified…

Three-dimensional (3D) digital anatomical models show potential to demonstrate complex anatomical relationships; however, the literature is inconsistent as to whether they are effective in improving the anatomy performance, particularly for students with low spatial visualization ability (Vz). This study investigated the educational effectiveness…

The structure of many science programs at the college level assumes that students are able to draw on and integrate ideas from multiple disciplinary contexts. However, most assessment tools focus on learning in the context of a single discipline. We describe the development and validation of an instrument to measure how well students are able to…

The aim of the study was to examine the common items in the mixed format (e.g., multiple-choices and essay items) contain parameter drifts in the test equating processes performed with the common item nonequivalent groups design. In this study, which was carried out using Monte Carlo simulation with a fully crossed design, the factors of test…

The first educational goal within scientific subjects is to acquire a sense of scientific literacy. In science lessons, methods of scientific inquiry provide the tools to achieve this. In this study, we based scientific inquiry on the SDDS-Model according to Klahr (2002). It is divided into three subareas: Search Hypothesis Space, Test Hypothesis,…

Students in the physical sciences--physics and chemistry--often take multiple-choice exams for introductory courses. Some students will write a lot on their exams, while others write very little. Does the student doing more scratch work on their exam perform better than one who does not write as much? We analyzed multiple-choice exams in physics…

With the increase in online teaching sessions, instructors face the need to engage and challenge their students in new ways. Online quiz sites provide teachers with a cost-free means of gaining immediate feedback on their students' progress. However, students can become bored if multiple-choice quizzes do not vary and are used too often. This…

In recent years, Automatic Item Generation (AIG) has increasingly shifted from theoretical research to operational implementation, a shift raising some unforeseen practical challenges. Specifically, generating high-quality answer choices presents several challenges such as ensuring that answer choices blend in nicely together for all possible item…

The purpose of this causal-comparative study was to determine if the pre-test and post-test scores differed for learners who used four hours of traditional test preparation and for learners who used four hours of Game enhanced test preparation, and if there was a difference on mean post-test scores between test preparation types, and the post-test…

This research uses Rasch model analysis to identify the reliability and separation index of an integrated mathematics test instrument with a cultural architecture structure in measuring students' mathematical thinking abilities. The study involved 357 students from six eighth-grade public junior high schools in Bima. The selection of schools was…

Student learning in simple electric circuits has been an important area in physics education research. This study builds off a previous investigation that applied the conceptual framework model to examine knowledge integration in student learning of simple electric circuits and developed a multiple-choice concept test for assessing knowledge…

This quasi-experimental research investigated the efficacy of applying the Society 5.0 concept to establish game-based learning on Metaverse Space for undergraduates in an international program in Bangkok, Thailand. The study was conducted in a Thai public university's international college with a population of six classes of junior university…