The "Next Generation Science Standards" calls for new assessments that measure students' integrated three-dimensional science learning. The National Research Council has suggested that these assessments utilize a combination of item formats including constructed-response and multiple-choice. In this study, students were randomly assigned…

Despite their drawback, multiple-choice questions are an enduring feature in instruction because they can be answered more rapidly than open response questions and they are easily scored. However, it can be difficult to generate good incorrect choices (called "distractors"). We designed an algorithm to generate distractors from a…

This paper extends prior work establishing an operationalized framework of mathematical sense making (MSM) in physics. The framework differentiates between the object being understood (either physical or mathematical) and various tools (physical or mathematical) used to mediate the sense-making process. This results in four modes of MSM that can…

This research aimed to investigate animation-based achievement tests according to the item format, psychometric features, students' performance, and gender. The study sample consisted of 52 fifth-grade students in Samsun/Turkey in 2017-2018. Measures of the research were open-ended (OE), animation-based open-ended (AOE), multiple-choice (MC), and…

Module analysis for multiple-choice responses (MAMCR) was applied to a large sample of Force Concept Inventory (FCI) pretest and post-test responses (N[subscript pre] = 4509 and N[subscript post] = 4716) to replicate the results of the original MAMCR study and to understand the origins of the gender differences reported in a previous study of this…

Multiple-choice questions (MCQ) are commonly used on histology examinations. There are many guidelines for how to properly write MCQ and many of them recommend avoiding negatively worded stems. The current study aims to investigate differences between positively and negatively worded stems in a medical histology course by comparing the item…

The optimum assessment structure measures student knowledge accurately and without bias. In this study, the performance of the first-year undergraduate science students from the University College Dublin was evaluated to test the gender equality of the assessment structure in place. Results of male and female students taking three life science…

This study investigated how students used information provided in given energy questions while answering these questions. Participant students were taking at least one college-level introductory science course and were asked to respond to two-tiered format (multiple-choice question and short written response question) energy questions addressing…

Measuring understanding is notoriously difficult. Indeed, in formulating learning outcomes the word 'understanding' is usually avoided, but in the sciences, developing understanding is one of the main aims of instruction. Scientific knowledge is factual, having been tested against empirical observation and experimentation, but knowledge of facts…

In this study, a valid and reliable multiple-choice achievement test has been developed in order to measure the academic achievement of 8th grade students about the units of "States of Matter and Heat" and "Electricity in Our Life". The pilot study of the achievement test was carried out with 30 questions which were prepared…

This study aimed to develop a learning progression (LP) for botanical literacy and assess the impact of a garden-based education course on Thai pre-service science teachers (n = 49). The inquiry- and community-based education course was taught over a 15-week period. To measure botanical literacy, a 50-item multiple-choice test was employed. A…

This research is conducted to identify the scientific conceptual cognition of ecosystem and the corresponding alternative conceptions by lower-secondary school students in Taiwan. Concept mapping, interviewing, and two-tier diagnostic test cannot make explicit reasoning pathways that students may use. Therefore, its purpose is to develop,…

Different versions of multiple-choice exams were administered to an undergraduate class in human physiology as part of normal testing in the classroom. The goal was to evaluate whether the number of options (possible answers) per question influenced the effectiveness of this assessment. Three exams (each with three versions) were given to each of…

The focus of biology education has shifted from memorization to conceptual understanding of core biological concepts such as matter and energy relationships. To examine undergraduate learning about matter and energy, we incorporated constructed-response (CR) questions into an interactive computer-based tutorial. The objective of this tutorial is…

Optics is a core field in the curricula of secondary physics education. In this study, we present the development and validation of a test instrument in the field of optics, the ray optics in converging lenses concept inventory (ROC-CI). It was developed for and validated with middle school students, but can also be adapted for the use in higher…