The assessment of vocational workplace-based qualifications in England relies on human assessors (raters). These assessors observe naturally occurring, non-standardised evidence, unique to each learner and evaluate the learner as competent/not yet competent against content standards. Whilst these are considered difficult to measure, this study…

For educational achievement tests that employ multiple-choice (MC) items and aim to reliably classify students into performance categories, it is critical to design MC items that are capable of discriminating student performance according to the stated achievement levels. This is accomplished, in part, by clearly understanding how item design…

Examined the discriminant validity, criterion-related validity, and between-spouse agreement for a marital intake interview as a function of interview method and valence of interview items. Results suggested a high degree of discriminant validity, higher interspouse correlations during joint interviews, and higher indices of criterion related…

Essential for an effective criterion-referenced testing program is a set of test items that are "valid" indicators of the objectives they have been designed to measure. Unfortunately, the complex matter of assessing item validity has received only limited attention from educational measurement specialists. One promising approach to the item…

A DESCRIPTION IS GIVEN OF ITEM SAMPLING, OR "PSYCHOMETRIC-STATISTICAL INFERENCE," AN APPROACH TO GATHERING AND USING EDUCATIONAL DATA THAT ALLOWS STATISTICAL INFERENCES TO BE MADE SIMULTANEOUSLY WITH PSYCHOMETRIC INFERENCES. THIS IS A PROCEDURE IN WHICH BOTH PEOPLE AND ITEMS ARE SAMPLED AND THE DATA FROM A SAMPLE OF PEOPLE TAKING A SAMPLE OF ITEMS…

In a continuing description of a Head Start longitudinal study, analyses are presented of the interrelationships among individual measures of the child's performances prior to school entry, accompanied by brief descriptions of the tasks and the scores used. Despite the size and extensiveness of the data base, the findings are considered tentative…

The combined field tests for the third follow-up survey of High School and Beyond (HSB) and the fifth follow-up survey of the National Longitudinal Study of the High School Class of 1972 (NLS-72) were conducted during the spring of 1985. The overall purposes of the field tests were to evaluate questionnaires and procedures to be used for the…

Increased demands for colleges and universities to engage in outcomes assessment for accountability purposes have accelerated the need to bridge the gap between higher education practice and the fields of measurement, assessment, and evaluation. The "Handbook on Measurement, Assessment, and Evaluation in Higher Education" provides higher…

Studies effects of the Paideia curriculum on critical thinking skills of 270 high school students in the Paideia curriculum and 284 in the standard curriculum. A problematic relationship exists between the treatment investigated and the measures used to collect data, supporting arguments for localized evaluation of Paideia Program efforts. (SLD)

The development and refinement of the measures of student achievement in reading and mathematics for the Beginning Teacher Evaluation Study are described. The concept of reactivity to instruction is introduced: the tests used to evaluate instructional processes must be sensitive indicators of classroom learning overtime. Data collection activities…

This volume describes the technical aspects of TIMSS 2003 and summarizes the main activities involved in the development of the data collection instruments, the data collection itself, and the analysis and reporting of the data. The thirteen chapters contained herein are: (1) Overview of TIMSS 2003 (Michael O. Martin and Ina V. S. Mullis); (2)…