The aim of the present research was to compare the use of multiple-choice questions (MCQs) as an examination method, to the examination based on constructed-response questions (CRQs). Despite that MCQs have an advantage concerning objectivity in the grading process and speed in production of results, they also introduce an error in the final…

In this study, we describe a framework for monitoring rater performance over time. We present several statistical indices to identify raters whose standards drift and explain how to use those indices operationally. To illustrate the use of the framework, we analyzed rating data from the 2002 Advanced Placement English Literature and Composition…

Although the Angoff procedure is among the most widely used standard setting procedures for tests comprising multiple-choice items, research has shown that subject matter experts have considerable difficulty accurately making the required judgments in the absence of examinee performance data. Some authors have viewed the need to provide…

Real and perceived misuses of educational tests, errors in test scoring and test use, and incidents of cheating on tests have been widely reported in local and national media. As educational tests take on additional importance for students, teachers, and schools, there is appropriate concern about the quality of assessments and the appropriate use…

The International Test Commission formed a 13-person committee of psychologists representing a number of international organizations to prepare a set of guidelines for adapting educational and psychological tests. The committee has worked for 3 years to produce near final drafts of 22 guidelines organized into 4 categories: (1) context; (2)…

The Joint Committee on Testing Practices has completed the "Code of Fair Testing Practices in Education," which is meant for the public and focuses on the proper use of tests in education--admissions, educational assessment and diagnosis, and student placement. The Code separately addresses test developers' and users' roles. (SLD)

Contains guidelines that provide an international view of areas of consensus about what constitutes "good practice" in test use. Guidelines address key competencies, such as knowledge and skills, and issues of professional and ethical standards in testing, the rights of test takers, test administration and scoring, and other issues. (SLD)

Marking is described as part of the central examinations for secondary general education in the Netherlands. These consist of two components: an external, and an internal school-based examination. Pedadogical implications of general school assessment practice, plus recent trends, are discussed. (BS)

One way to manage marking error, in a large-scale educational testing context, is to establish a mechanism through which appeals can be lodged. While, at one level, this seems to offer a straightforward technical solution to the problem of marking error, it can also result in unintended consequences, with political, social or educational…

THE PURPOSE OF TESTING IN SEASONAL AND MIGRANT FARMERS' EDUCATIONAL PROGRAMS IS NOT FOR MEASUREMENT BUT FOR DIAGNOSIS OF THE DEGREE AND INTENSITY OF HELP NEEDED. TESTS SHOULD BE ADMINISTERED BY THE TEACHER TWO OR THREE WEEKS AFTER CLASS BEGINS WHEN POSSIBLE. THEY SHOULD BE SCORED CAREFULLY, AND THE RESULTS ANALYZED AND INTERPRETED. THE AUTHOR…

Instructional programs organized according to modern educational technology are discussed within the purposes of criterion-referenced measurements used. The problems of criterion-referenced measurements include scoring and score interpretation, item and test analysis, and mastery testing. An overview of solutions and approaches to the problems and…

This guide--written for school administrators, teachers, counselors, parents, and the community--describes educational tests and measurements and test-related statistics. While specifically intended to help readers interpret the tests administered in the Los Angeles (California) Unified School District, this information may also be used to…

This monograph serves as a nontechnical guide to teachers, counselors, school psychologists, administrators, parents, and others who use the 1974 Standards for Educational and Psychological Tests. The Standards are a concise summary of standards and guidelines for the development, evaluation, interpretation, use, and reporting of information on…

This paper clarifies important distinctions in item writing and item scoring and considers the implications of these distinctions for developing guidelines related to test construction for training teachers. The terminology used to describe and classify paper and pencil test questions frequently confuses two distinct features of questions:…

Problems in constructing criterion referenced tests related to inadequate technical criteria, and guidelines for their solution are discussed. The need to select a well-defined domain of behaviors is emphasized as the key to test construction and to understanding students' test performance. Considerations must also be given to the most effective…