Studied the impact of practice tests on students' calibration and examination performance for multiple-choice and essay examinations. Results for 59 graduate students show that practice tests were associated with significantly lower scores on the midterm multiple-choice items and less accurate predictions and postdictions on these items. Discusses…

Describes four measures of test unreliability that quantify effects of question selection and guessing, both separately and together--three chosen for immediacy and one for greater mathematical elegance. Quantifies their dependence on test length and number of answer options per question. Concludes that many multiple choice tests are unreliable…

Compares the costs of four assessment formats: (1) multiple choice; (2) open ended; (3) laboratory station; and (4) full investigation. Tracks the amount of time spent preparing the devices, developing scoring consistency for the devices, and scoring the devices as they were developed. Compares times as if 1,000 students completed each assessment.…

The potentially huge number of questions in a national database offers the opportunity for open testing where each student has his own test and can take the test in his own time, saving on supervision and PCs. (Author/ASK)

This volume describes the characteristics and functions of test items, presents editorial guidelines for writing test items, presents methods for determining the quality of test items, and presents a compendium of important issues about test items. (SLD)

This research examined 2 elements of multiple-choice test construction, balancing the key and optimal number of options. In Experiment 1 the 3 conditions included a balanced key, overrepresentation of a and b responses, and overrepresentation of c and d responses. The results showed that error-patterns were independent of the key, reflecting…

In the class session following feedback regarding their scores on multiple-choice exams, undergraduate students in a large human development course rated the strength of possible contributors to their exam performance. Students rated items related to their personal effort in preparing for the exam (identified as student effort in the paper), their…

A statistical test for the detection of answer copying on multiple-choice tests is presented. The test is based on the idea that the answers of examinees to test items may be the result of three possible processes: (1) knowing, (2) guessing, and (3) copying, but that examinees who do not have access to the answers of other examinees can arrive at…

The aims of the study were to use differentiated online learning material for use with a Level 1 statistics module for undergraduate sport students and examine relationships between student performance on differentiated tests and module performance. We developed the differentiated material by writing easy and hard multiple choice tests, with the…

A total of 156 students were asked to provide free-response balanced chemical equations for a classic multiple-choice particulate-drawing question first used by Nurrenbern and Pickering. The balanced equations and the number of students providing each equation are reported in this study. The most common student errors included a confusion between…

The limitations of teaching and assessment of knowledge are emphasized, and an improved method is suggested to test the students. This superior examination technique would replace multiple-choice questions with free-response questions for numerical problems, wherein the numerical inputs fed in the computer would be optically scanned and graded…

A Web-based tool that allows students to generate multiple-choice questions in a collaborative, distributed setting was evaluated through several comparisons. Students first completed a Web-based tutorial on writing effective multiple-choice questions and then authored questions on a given topic. Next, using the Web-based tool, groups of students…

The purpose of this study was to examine whether instructor perceptions of student responsive behaviors and student socio-communicative style were related to instructors' subjective (speech presentation) and objective (multiple-choice exam) assessments of student work. The results suggest that student nonverbal and verbal responsive behaviors…

The authors investigated absolute and relative metacomprehension accuracy as a function of verbal ability in college students. Students read hard texts, revised texts, or a mixed set of texts. They then predicted their performance, took a multiple-choice test on the texts, and made posttest judgments about their performance. With hard texts,…

Based on a previously validated cognitive processing model of reading comprehension, this study experimentally examines potential generative components of text-based multiple-choice reading comprehension test questions. Previous research (Embretson & Wetzel, 1987; Gorin & Embretson, 2005; Sheehan & Ginther, 2001) shows text encoding and decision…