The aim of the study was to examine the common items in the mixed format (e.g., multiple-choices and essay items) contain parameter drifts in the test equating processes performed with the common item nonequivalent groups design. In this study, which was carried out using Monte Carlo simulation with a fully crossed design, the factors of test…

The discussion of whether multiple-choice questions can replace the traditional exam with essays and constructed questions in introductory courses has just started in Norway. There is not an easy answer. The findings depend on the pattern of the questions. Therefore, one must be careful in drawing conclusions. In this research, one will explore a…

Automated scoring systems are typically evaluated by comparing the performance of a single automated rater item-by-item to human raters. This presents a challenge when the performance of multiple raters needs to be compared across multiple items. Rankings could depend on specifics of the ranking procedure; observed differences could be due to…

This study offers evidence of the impact of language background on the performance of students enrolled in an accounting study unit. It aims to quantify the effects of language background on performance in essay questions, compared to calculation questions requiring an application of procedures. Marks were collected from 2850 students. The results…

Written examinations represent one of the most common assessment tools in education. Though typically perceived as measurement instruments, written examinations are primarily texts that perform a communicative function. To complement existing research, this study viewed written examinations as a distinct form of communication (i.e. 'register').…

Presented at the national conference for the American Educational Research Association (AERA) in 2009. This discussed the development and implementation of the new SAT writing section.

Defends the CUNY-WAT against the charges made by Fishman (CS 731 865). Offers suggestions for those wishing to undertake research into the choice of topics for writing assessment tests. (FL)

Many textbooks in educational measurement and classroom assessment have chapters devoted to specific item formats. There may be attempts to relate one item format to another, but the chapters and item formats are largely seem as distinct entities with only loose and uncertain connections. This paper synthesizes these discussions. An item format…

Examines the CUNY-WAT program and questions many aspects of it, especially the choice and phrasing of topics. (FL)

The third of three sequels to the booklet "Student Assessment," this booklet begins by describing and giving examples of three forms that essay-type questions can take: (1) unstructured-essay questions; (2) structured-essay questions; and (3) short-notes questions. Guidelines are then provided for deciding which type of question to use in a given…

This fastback concentrates on writing technically correct test items that are compatible with the teacher's instructional objectives. The introductory chapter touches on some of the problems associated with preparing classroom tests. The second chapter outlines five steps in preparing a test according to the "Plan-Write" System: (1) prepare a…

Responses to a sample test were simulated for examinees under free-response and multiple-choice formats. Test score sets were correlated with randomly generated sets of unit-normal measures. The extent of superiority of free response tests was sufficiently small so that other considerations might justifiably dictate format choice. (Author/DWH)

Two alternatives to traditional item analysis and reliability estimation procedures are considered for determining the difficulty, discrimination, and reliability of optional items on essay and other tests. A computer program to compute these measures is described, and illustrations are given. (SLD)

Traditional tests fall into two categories, both of which have several advantages and disadvantages that need to be considered when determining the type of test to use. Constructed-response tests, such as essay tests, ask students to construct their own responses. Thus, students are required not only to recall but to organize and often apply…

A sample of l34 adults enrolled in adult education programs for credit ranked types of test items. From most to least preferred, the five types of test item were multiple choice, true/false, matching, fill-in-the-blank, and essay. Respondents also explained which type of test item contributed to anxiety for them. Vaguely written essay questions…