In order to construct and evaluate the validity argument for the Objective Structured Assessment of Technical Skills (OSATS), based on Kane's framework, we conducted a systematic review. We searched MEDLINE, EMBASE, CINAHL, PsycINFO, ERIC, Web of Science, Scopus, and selected reference lists through February 2013. Working in duplicate, we selected…

Twenty-two handicapped and 10 nonhandicapped young children were administered the Evaluation and Programing System Level 1 (EPS-1), a measure designed to provide information to develop educational programs and assess program effectiveness. The article notes reliability, validity, and utility data. (Author/CL)

The "CSE Program Evaluation Kit" is a series of nine books intended to assist people conducting program evaluations. This volume, the seventh in the kit, provides an overview of a variety of approaches to measuring performance outcomes. It presents considerations in deciding what to measure and in selecting or developing instruments best suited to…

One of several papers commissioned by the National Institute of Education (NIE), this discussion addresses the utility of test-equating studies for large-scale program evaluation and investigates the use of standardized tests in similar evaluation efforts. The discussion begins with an examination of the question, Should standardized achievement…

A procedure for testing the ability of dental students to detect presence and depth of dental caries was evaluated. Students (n=40) from four experience groups examined radiographs obtained from a model. Results indicated that this method of assessing student competence in radiographic interpretation is valid. (MSE)

This paper discusses and describes an industry-based process for the design and development of criterion-referenced tests in vocational-technical subject areas to support vocational program evaluations. The following topics are covered in the paper: (1) use of criterion-referenced tests; (2) test design; (3) preparation of test materials; and (4)…

This document traces the development of the testing and reporting system used in the Elkhart Community Schools (ECS), Indiana, from 1981 through 1985. Performance objectives were established when the program was initiated. Analyses of standardized test results were provided for teachers, principals, and central administrative staff. All school…

This paper explores what a responsible test developer would do to support the consequential validity of a test early in the development process, and how the consequential validity of the program should be monitored and addressed during the life of the program. To illustrate the issues concretely, the validity of the American College Testing…

The question of how standardized tests can be better developed to improve educational program evaluation is probed in this paper. After the first section's brief introduction, section 2 explores the thesis that tests developed in terms of selection and inference may not serve current social functions of educational testing. To clarify this thesis,…

The Conflict Tactics Scales (CTS) are intended to measure use of nonviolent discipline, psychological aggression, and physical assault in parent-child and other family relationships. The latter two scales provide a basis for identifying psychological and physical maltreatment. Two revisions of the CTS became available in 1996. One, the CTS2 is…

The Statewide Assessment Program, administered by the Alaska Department of Education, tests all fourth and eighth graders in math and reading biennially. In 1985, the Department's Office of Evaluation, Assessment and Research undertook an evaluation of the assessment program to identify procedures which needed improvement and to determine the…

This book is designed to provide future and experienced educators and other professionals with a fundamental understanding of traditional and contemporary perspectives on the assessment of children and youth, aged 3 through 21. It features broad coverage of traditional and contemporary assessment approaches. Individual tests are discussed at…

The Moderation and Assessment Project, South West, was an outgrowth of the Technical and Vocational Educational Initiative of the government of the United Kingdom that attempted to develop more courses with vocational relevance for adolescents. Growing from research projects under the Moderation and Assessment project, a new model of moderation is…

The Pre-Professional Skills Tests (PPST), was developed at Educational Testing Service at the request of the National Teachers Examination Policy Council. The battery of three tests is designed to provide objective, standardized measures of basic proficiency in reading, mathematics, and writing. The steps in the test development process of this…

A cut score validity analysis for a pretest writing prompt and the SAT Verbal and Math assessments was performed for academic writing course placement. This study was carried out as part of a broader program of assessment aimed at understanding the impact of the writing course and eventually set the baseline for assessing the impact of 'writing…