This paper examines the development and evaluation of criterion-referenced measures, and elaborates on the distinction between them and norm-referenced measures. The concept of sensitivity is introduced as an appropriate method for evaluating such measures, and a sensitivity index is proposed. The traditional model for the response of a subject to…

Describes an analysis of test items used to measure the science process skills of 11-year-olds in Great Britain. Concludes that the level of cognitive demand was a reliable predictor of the difficulty of an item. (TW)

Describes responses of fifth to eighth grade students to different types of test items requiring estimation. Reports that performance differed by item format, types of numbers and operations in the items, and grade level of students. (Author/YP)

Effectiveness in presenting information of a modified box plot and a multivariate STAR graph was compared with that of tables for a sample audience for evaluation results (133 school superintendents, 123 journalists, 100 school board members, 100 principals, 100 teachers). Individual item analysis offers guidance for designing multivariate…

This article addresses an important problem that faces educators in assessing students' competence levels in learned tasks. Data from 165 students from Massachusetts and Minnesota in the United States are used to examine the validity of five assessment modes (multiple choice test, scenario, portfolio, self-assessment and supervisor rating) in…

In this study, the author tested the reliability, concurrent validity, and predictive validity of three hemispheric cognitive style instruments: (a) the Preference Test (PT; R. Zenhausern, 1978), (b) the Polarity Questionnaire (PQ; B. E. Morton, 2002), and (c) the Wagner Preference Inventory II (WAPI II; R. F. Wagner & K. A. Wells, 1985).…

This book offers specific how-to advice to college faculty on every stage of the testing process, including planning the test and classifying objectives to be measured, ensuring the validity and reliability of the test, and grading in such a way as to arrive at fair grades based on relevant data. The book examines the strengths and weaknesses of…

This first test and technical manual explains the development, purpose, use, validity, and reliability of the criterion-referenced final examination for the Chemistry of Hazardous Materials course of the National Fire Academy in Emmitsburg (Maryland). Because of possible diversity in the testing knowledge and background of readers, the manual…

The construct underlying simple paper-and-pencil logical operations tasks administered to young children in group settings was examined. The logical operations, number concepts, and visual discrimination subtests of the Early School Assessment (ESA) were administered as part of the Fall 1987 national tryout of the ESA. The mathematics concepts and…

Florida requires all students in grades 3, 5, 8, and 11 to demonstrate mastery of minimum performance standards using the Florida Student State Assessment Test (SSAT) forms for the appropriate grade level. The tests are administered in October and cover reading, writing, and mathematics. Current practices used to prepare students for the SSAT…

The operational preparations for the Dutch national assessment program in education started in 1986. The program's aim is to periodically describe the contents of the curriculum in use and the attainment of 8-year-old and 11-year-old students on a national basis by means of surveys. In this paper some of the guiding principles in instrument…

This paper demonstrates the relationship between the concept of unidimensionality and direction of an item in a multidimensional space. The basic premise is that if items that measure in the same direction are combined to form a test, that test will meet the item response theory requirements of unidimensionality. This will be true even if the…

This study hypothesized that items in the one-question-per-passage format would be less easily answered when administered without their associated contexts than conventional reading comprehension items. A total of 256 seventh and eighth grade students were administered both Forms 3A and 3B of the Sequential Tests of Educational Progress (STEP 11).…

The Comprehensive Tests of Basic Skills, Expanded Edition (CTBS), was administered in 1984 to students in the District of Columbia Public Schools. This report includes: (1) an overview covering the purpose of testing, a description of the subject areas tested by the CTBS, and a glossary of technical terms; (2) a narrative and tabular summary of…

The Nevada Department of Education implemented a standard setting study of the Pre-Professional Skills Tests. The tests constitute a secure test battery developed by the Educational Testing Service to assess basic proficiency in reading, writing, and mathematics via three multiple-choice tests and a written essay test. The Nevada study, in the…