Limited research has been conducted on the spatial ability of veterinary students and how this is evaluated within anatomy assessments. This study describes the creation and evaluation of a split design multiple-choice question (MCQ) assessment (totaling 30 questions divided into 15 non-spatial MCQs and 15 spatial MCQs). Two cohorts were tested,…

Introduction: This article aimed at digging deep into distractors used for mathematics multiple-choice items. The quality of distractors may be more important than their number and the stem in a multiple-choice question. Little attention is given to this aspect of item writing especially, mathematics multiple-choice questions. This article…

Understanding particle motion in force fields (PMFF), which encompasses the nature of forces and the relationship between force and motion, is fundamental to mastering mechanics and electromagnetism. Effectively solving PMFF-related problems requires advanced reasoning skills and the ability to apply knowledge across diverse contexts. Despite…

The test of understanding graphs in kinematics (TUG-K) has widely been used to assess students' understanding of this subject. The TUG-K poses different objectives to the test takers such as (1) the selection of a graph from a textual description, (2) the selection of corresponding graphs, and (3) the selection of a textual description from a…

The current study investigated how item formats and their inherent affordances influence test-takers' cognition under uncertainty. Adult participants solved content-equivalent math items in multiple-selection multiple-choice and four alternative grid formats. The results indicated that participants' affirmative response tendency (i.e., judge the…

This classroom experiment investigates the effects of adding representational pictures to multiple-choice and constructed-response test items to understand the role of the response format for the multimedia effect in testing. Participants were 575 fifth- and sixth-graders who answered 28 science test items--seven items in each of four experimental…

Writing multiple-choice test items to measure student learning in higher education is a challenge. Based on extensive scholarly research and experience, the author describes various item formats, offers guidelines for creating these items, and provides many examples of both good and bad test items. He also suggests some shortcuts for developing…

We report on a study investigating the influence of context, direction of translation, and function type on undergraduate students' ability to translate between graphical and symbolic representations of mathematical relations. Students from an algebra-based and a calculus-based physics course were asked to solve multiple-choice items in which they…

In this paper we report the results of an experiment designed to test the hypothesis that when faced with a question involving the inverse direction of a reversible mathematical process, students solve a multiple-choice version by verifying the answers presented to them by the direct method, not by undertaking the actual inverse calculation.…

People need the idea of transformation geometry in order to understand the nature and environment they live in. The teachers should provide learning environments towards perceptual understanding in symmetry training and development practice skills of the students. In order to make up such a learning environment, teachers should have information…

There are many reasons to believe that open-ended (OE) and multiple-choice (MC) items elicit different cognitive demands of students. However, empirical evidence that supports this view is lacking. In this study, we investigated the reactions of test takers to an interactive assessment with immediate feedback and answer-revision opportunities for…

The purpose of this study was to determine whether multiple-choice and constructed-response items assessed prospective secondary mathematics teachers' understanding of the concept of function. The conceptual framework for the study was the Dreyfus and Eisenberg (1982) Function Block. The theoretical framework was Sierpinska's (1992, 1994)…

Although test scores from similar tests in multiple choice and constructed response formats are highly correlated, equivalence in rankings may mask differences in substantive strategy use. The author used an experimental design and participant think-alouds to explore cognitive processes in mathematical problem solving among undergraduate examinees…

For several decades, the "three-parameter logistic model" (3PLM) has been the dominant choice for practitioners in the field of educational measurement for modeling examinees' response data from multiple-choice (MC) items. Past studies, however, have pointed out that the c-parameter of 3PLM should not be interpreted as a guessing…

A new item type was developed, incorporating features of "ill-structured" problems in a multiple-choice format. The problems are similar to previously developed scientific thinking tasks in requiring the examinee to go beyond the information provided; they resemble a variant of the logical reasoning item type, but demand somewhat more structuring…