A description of the difficulties encountered in constructing a criterion-referenced test to assess end-of-year skills as part of a program evaluation is presented. The problems encountered in preparing the customized test are described in humorous detail. The first problem involved the listening test obtained from a publisher without…

The Chicago Public Schools have been developing and implementing a citywide instructional program of continuous progress/mastery learning in reading. It includes the delineation of a K-8 continuum of instructional objectives; a criterion-referenced testing program which serves as the basis for instruction, promotion, and administrative monitoring;…

As change occurs in various health sciences programs, evaluational strategies should be developed so that adaptive decisions may be made. Evaluation models taking into account inputs, methodology, and outputs (Stake, 1967, and Astin and Panes, 1971) need examination. Alternative measurement instruments for formative and summative evaluations,…

This paper discusses and describes an industry-based process for the design and development of criterion-referenced tests in vocational-technical subject areas to support vocational program evaluations. The following topics are covered in the paper: (1) use of criterion-referenced tests; (2) test design; (3) preparation of test materials; and (4)…

A discussion of the role of second language proficiency assessment in the evaluation of language programs argues that for four reasons, the use of proficiency is inappropriate as a central element in evaluation. The reasons are: (1) the construct of proficiency has not been operationalized in a way that enables it to be used usefully; (2)…

Recent changes in the structure of curriculum and the instructional system in Texas have required a major reorganization of teaching, evaluating, budgeting, and planning activities in the local education agencies, which has created the need for a database. The history of Richardson Instructional Management System (RIMS), its data processing…

Research evidence relating to the utility of the RMC evaluation models of compensatory education employing non-normed tests is examined. The history and evolution of five early models into the current norm-referenced model utilizing a non-normed test (Model A2), non-normed versions of a comparison model (Model B2), and the regression model (Model…

This speech presents instructional evaluation techniques currently used in Belleville, Illinois. These are based on two criteria: (1) community opinion, and (2) performance level of students. To discover community opinions, needs, priorities, and levels of support, questionnaires are distributed, presenting a series of curricular goals and…

In the first part of the paper, some realistic expectations about schools and curriculum development, the conditions which preclude applying the standards of basic research to evaluate a program of instruction in large school systems, and some new research paradigms which have emerged from practice are defined. In the second part, an effort is…

Two ESEA Title I evaluation models developed by the Resource Management Corporation (RMC), were field tested simultaneously with 560 Title I reading students, grades 2-8. Measuring instruments for models 1 and 2 were, respectively, the California Achievement Test (reading vocabulary section), a norm-referenced test; and the Tarmac Reading…

A statewide sustained effort to improve student learning in Missouri by adopting and adapting promising research-based educational practices is described. The concept of an Instructional Management System (IMS) with desired learner outcomes determining both instruction and testing was suggested to local school districts beginning in 1980. In 1985,…

In 1984 an evaluation team examined the Maryland Functional Testing Program (MFTP), a statewide competency-based, criterion-referenced testing program that was instituted to limit awarding of high school diplomas to those students who had earned scores above cut scores on a series of achievement tests. This article examines the procedures the…

Technical considerations associated with item selection and reliability assessment are considered in relation to criterion-referenced tests constructed to provide group information. The purpose is to emphasize test building and the evaluation of test scores in program evaluation studies. It is stressed that an evaluator employ a performance or…

The potential use of criterion referenced tests (CRT) and norm referenced tests (NRT) in the same testing program is discussed. The advantages and disadvantages of each are listed, and the best solution, a merging, is proposed. To merge CRTs and NRTs into an overall testing program, meaningful and useful to all levels, consideration must be given…

While much has been written on the topic of criterion-referenced testing and consequently its comparison with norm-referenced testing, measurement specialists have not as readily approached the subject of the implications involved in reporting such test information. The purposes of this paper are to (1) draw distinctions between criterion and…