This study reports on the development and application of a four-tier multiple-choice (4TMC) diagnostic instrument, which has not been reported in the literature. It is an enhanced version of the two-tier multiple-choice (2TMC) test. As in 2TMC tests, its answer and reason tiers measure students' content knowledge and explanatory knowledge,…

This article presents a new method to detect copying on a standardized multiple-choice exam. The method combines two statistical approaches in successive stages. The first stage uses Kullback-Leibler divergence to identify examinees, called subjects, who have demonstrated inconsistent performance during an exam. For each subject the second stage…

The purpose of this study was to assess the effectiveness of a traditional lecture-based curriculum versus a modified "flipped classroom" curriculum of cardiovascular, respiratory, and renal physiology delivered to first-year graduate students. Students in both courses were provided the same notes and recorded lectures. Students in the…

The present study examines the effects of different study tasks on the acquisition of knowledge about acids and bases in a computer-based learning environment. Three different task formats were selected to create three treatment conditions: learning with gap-fill and matching tasks, learning with multiple-choice tasks, and learning only from text…

Recent studies show that a new strategy called differential-associative processing is effective for learning related concepts; however, our knowledge about differential-associative processing is still limited. Therefore the goals of the present study are to assess the duration of knowledge that is acquired from using differential-associative…

We examine the influence of factual and perceived world knowledge on global citizenship identification. Perceived world knowledge directly predicted global citizenship identification, while factual world knowledge did not (Study 1). Students' factual (Study 1) and perceived (Study 2) world knowledge predicted students' normative environment…

This study compared active teaching strategies with passive lecture by evaluating cognitive, affective, and psychomotor learning outcomes, while highlighting end-of-life communication in nursing education. The problem addressed was twofold: First, passive lecture prevents transfer to situational decision-making, or a sense of salience (Benner,…

An introductory geology class that satisfies a liberal arts distribution requirement was used to investigate the benefits of allowing discussion during assessments. For three term examinations, students completed short- to medium-length essay tests individually (individual examination) and then again as part of an assigned group of four to five…

The purpose of this study was to examine the effects of answer copying on the ability level estimates of cheater examinees in answer copying pairs. The study generated answer copying pairs for each of 1440 conditions, source ability (12) x cheater ability (12) x amount of copying (10). The average difference between the ability level estimates…

The authors present work towards automatically assessing data collection behaviors as middle school students engage in inquiry within a physics microworld. In this study, the authors used machine learned models that can detect when students test their articulated hypotheses, design controlled experiments, and engage in planning behaviors using…

Test items are designed to provide information about the examinees. Difficult items are designed to be more demanding and easy items are less so. However, sometimes, test items carry with their demands other than those intended by the test developer (Scheuneman & Gerritz, 1990). When personal attributes such as gender systematically affect…

The purpose of this paper is to show the similarities as well as the differences of fundamental fraction knowledge owned by preservice elementary teachers from the United States (N = 89) and Taiwan (N = 85). To this end, we examined and compared their performance on an instrument including 15 multiple-choice test items. The items were categorized…

This paper presents preliminary data on how an assessment instrument with a unique structure can be used to identify common incorrect ideas from prior coursework at the beginning of a biochemistry course, and to determine whether these ideas have changed by the end of the course. The twenty-one multiple-choice items address seven different…

Both multiple-choice and constructed-response items have known advantages and disadvantages in measuring scientific inquiry. In this article we explore the function of explanation multiple-choice (EMC) items and examine how EMC items differ from traditional multiple-choice and constructed-response items in measuring scientific reasoning. A group…

Different computational models for generating analogies of the form "A is to B as C is to D" have been proposed over the past 35 years. However, analogy generation is a challenging problem that requires further research. In this article, we present a new approach for generating analogies in Multiple Choice Question (MCQ) format that can be used…