The educational implications of criterion-referenced tests are demonstrated. It is the hypothesis of the author that criterion-referenced tests have little educational impact unless carefully constructed around rigorous domain specifications. The paper details the process and problems of construction of a series of history tests presently being…

Twenty-two handicapped and 10 nonhandicapped young children were administered the Evaluation and Programing System Level 1 (EPS-1), a measure designed to provide information to develop educational programs and assess program effectiveness. The article notes reliability, validity, and utility data. (Author/CL)

Describes two types of criterion-referenced testing that districts can use to measure achievement outcomes of their instructional programs: a random sampling assessment plan and an item-response theory assessment plan. (Author/JM)

In studying the effectiveness of different instructional programs, a criterion measure can favor one of the programs because there is greater overlap between the content covered on the test and in that program. This overlap can be measured using teacher estimates or teacher estimates combined with curriculum analysis. (Author/BW)

This report represents the results of an investigation of the appropriateness of criterion-referenced tests (CRTS) for large-scale evaluations. First, the development and validation of CRTS, including the formulation and generation of CRT objectives, items, and score-interpretation schemes and dimensions of item and test quality, were examined to…

This paper discusses and describes an industry-based process for the design and development of criterion-referenced tests in vocational-technical subject areas to support vocational program evaluations. The following topics are covered in the paper: (1) use of criterion-referenced tests; (2) test design; (3) preparation of test materials; and (4)…

This article examines what types of language tests are suitable in evaluating instructional programs in testing for educational accountability. Norm-referenced measurements are found unsuitable for this purpose; new, criterion-referenced tests must be developed. (CHK)

This study examined the appropriateness of the use of criterion referenced tests as a means of controlling an individual student's advancement to the next level of instruction or retention in the current unit in the PLATO Air Force Base Computer-Based Education project at Chanute. The study was also concerned with program evaluation, which…

The criterion issues in the area of outcome research in psychotherapy were addressed and reviewed. Through this review of previous outcome research, it was determined that three basic criterion areas related best to traditional outcome variables such as therapist and community informant ratings, length of stay, and rehospitalization. These three…

PLANA is a training program for subject matter analysis and construction of instructional objectives. This investigation tries to find out whether education students in the PLANA program differ from other students on planning instruction processes. (BW)

Two ESEA Title I evaluation models developed by the Resource Management Corporation (RMC), were field tested simultaneously with 560 Title I reading students, grades 2-8. Measuring instruments for models 1 and 2 were, respectively, the California Achievement Test (reading vocabulary section), a norm-referenced test; and the Tarmac Reading…

Technical considerations associated with item selection and reliability assessment are considered in relation to criterion-referenced tests constructed to provide group information. The purpose is to emphasize test building and the evaluation of test scores in program evaluation studies. It is stressed that an evaluator employ a performance or…

The feasibility of using criterion referenced tests (CRTs) in a large-scale evaluation conducted in an effectiveness evaluation context was investigated. The study began by examining the theory that structures the development and validation of CRTs to discover whether, on theoretical grounds alone, CRTs are suitable or not suitable for large-scale…

The question of how standardized tests can be better developed to improve educational program evaluation is probed in this paper. After the first section's brief introduction, section 2 explores the thesis that tests developed in terms of selection and inference may not serve current social functions of educational testing. To clarify this thesis,…

A procedure was developed to combine subsets of curriculum-relevant items from a norm-referenced achievement test (NRT) with items comprising a locally-developed supplementary test in order to produce objective-referenced test (ORT) data for program evaluation. The study was designed to determine whether the ORTs were valid instruments for program…