An odds ratio approach (ORA) under the framework of a nested logit model was proposed for evaluating differential distractor functioning (DDF) in multiple-choice items and was compared with an existing ORA developed under the nominal response model. The performances of the two ORAs for detecting DDF were investigated through an extensive…

First year undergraduate courses in higher education tend to be designed based on assumptions of students' prior knowledge. Almost 600 undergraduates at five UK universities, studying biological sciences, were given an MCQ test in their first week at university, based on biology A-level (pre-university examination) core criteria. Results…

Students in an introductory psychology class rated their level of confidence in their answers to exam questions on four multiple-choice exams through the course of a semester. Correlations between confidence judgments and accuracy (correct vs. incorrect) at the individual item level showed modest but significant relationships for item sets scaled…

The present study examined the effect of reading goals on the processing and memory of central and peripheral textual information. Using eye-tracking methodology, we compared the effect of four common reading goals--entertainment, presentation, studying for a close-ended (multiple-choice) questions test, and studying for an open-ended questions…

The purposes of this study were 1) Compare analytical thinking ability by testing the same sets of students 5 times 2) Develop and verify whether analytical thinking ability of students corresponds to second-order growth curve factors model. Samples were 1,093 eighth-grade students. The results revealed that 1) Analytical thinking ability scores…

A large body of work has been devoted to reducing assessment biases that distort inferences about students' science understanding, particularly in multiple-choice instruments (MCI). Constructed-response instruments (CRI), however, have invited much less scrutiny, perhaps because of their reputation for avoiding many of the documented biases of…

Children's emergent literacy skills are highly predictive of later reading abilities. To determine which children have weaker emergent literacy skills and are in need of intervention, it is necessary to assess emergent literacy skills accurately and reliably. In this study, 1,351 children were administered the "Revised Get Ready to…

Instruments measuring understanding of the nature of science (NOS) are required if educational institutions intend to use benchmarks or examine the effects of interventions targeting students' NOS development. Compared to other constructs, NOS understanding is complex, having been the subject of debate among scholars in both its substance and its…

This study investigates the impact that study in Australia has on the lexical knowledge of Saudi Arabian students. It focuses on: 1) the effects that the length of study in Australia has on the acquisition of lexical collocations, as reflected by lexical knowledge tests, and 2) whether there is a significant gender difference in the acquisition of…

The kinematics concept test (KCT) is a multiple-choice test designed to evaluate students' conceptual understanding of kinematics at the high school level. The test comprises 49 multiple-choice items about velocity and acceleration, which are based on seven kinematic concepts and which make use of three different representations. In the first part…

The purpose of this study was to explore Pre-service Elementary Science Teachers' (PSTs) conceptual understanding of Particulate Nature of Matter (PNM) through a three-tier diagnostic test. Participants were 215 PSTs from Turkey. Data consisted of participants' responses to the Particulate Nature of Matter Test (PNMT). The PNMT consists of…

We present a strategy for the acquisition and assessment of autonomous learning conducted as part of the Graphic Expression in Engineering (GE) degree course during the first quarter at the Escola Universitària d'Enginyeria Tècnica Industrial de Barcelona (EUETIB). The strategy employed is the puzzle technique in the classroom and multiple-choice…

Geoscience education researchers have considerable need for criterion-referenced, easy-to-administer, easy-to-score, conceptual surveys for undergraduates taking introductory science survey courses in order for faculty to monitor the learning impacts of innovative teaching. In response, this study establishes the reliability and validity of a…

Background: The context-based approach (CBA) is one of the approaches that allow learning to take place with real and related context, and this has increasingly become more popular. Purpose: The purpose of this study is to investigate the effect of the REACT strategy of the CBA on remedying 12th grade students' alternative conceptions of…

The present study examined the technical adequacy of maze-selection tasks constructed in 2 different ways: typical versus novel. We selected distractors for each measure systematically based on rules related to the content of the passage and the part of speech of the correct choice. Participants included 262 middle school students who were…