The current study will examine possible contextual effects relative to differences in reading comprehension performance in the state of Florida. While the Reading First (RF) Impact study examined such difference using a regression discontinuity design, the authors are primarily interested in other analytic methods that might answer different…

This booklet briefly describes the potentials and problems of different ways of assessing the short-term impact of early childhood Title I (ECT-I) programs. It is intended for education officials and evaluators who already know something of Title I evaluation, but who may not be familiar with the special issues involved in evaluation of early…

Three types of evaluation used in program evaluation and the type of instrument or measure used are discussed. The three types of evaluation are: comparison group evaluation, analysis of learner outcome or product objectives, and process evaluation. Measurements employed are either direct or indirect. Most measurement in education is usually…

Investigated two variance estimation procedures on a normed test treated as a criterion-referenced test. The first estimation procedure estimated the standard deviation systematically higher, whereas the second procedure's estimation was systematically lower than the actual standard deviation. (Author/RC)

Criterion-referenced tests in a time-series design were found to be the most feasible methodology for evaluating placement in an early intervention program for mildly retarded, learning disabled, and emotionally disturbed children. Advantages included provision of longitudinal data, while the major disadvantage was administration time. (CL)

This book presents a compilation of 28 issues of the newsletter, "How To Evaluate Education Programs" from the first one published in September 1977 through the issue of December 1979 on the topic of evaluating educational programs. The subject is covered in the following chapters: (1) How to Choose a Test; (2) How to Rate and Compare…

As change occurs in various health sciences programs, evaluational strategies should be developed so that adaptive decisions may be made. Evaluation models taking into account inputs, methodology, and outputs (Stake, 1967, and Astin and Panes, 1971) need examination. Alternative measurement instruments for formative and summative evaluations,…

Fourteen criteria used to evaluate criterion referenced tests were assigned two sets of weights reflecting the characteristics of tests designed as a classroom resource or for program evaluation. Twenty eight currently available criterion referenced tests were rated against the criteria using each set of weights. A comparison of the scores…

This paper discusses and describes an industry-based process for the design and development of criterion-referenced tests in vocational-technical subject areas to support vocational program evaluations. The following topics are covered in the paper: (1) use of criterion-referenced tests; (2) test design; (3) preparation of test materials; and (4)…

The Michigan accountability system, based on statewide objectives-referenced testing at two grade levels generated considerable controversy, including this response to criticisms of an evaluation of the program by a panel of three persons. The contract under which the evaluation was performed is quoted to show that the authors of the report were…

Because of misconceptions regarding appropriate measurement strategies, it is necessary to draw distinctions between two major measurement methodologies, norm-referenced and criterion-referenced measurement, as they relate to determining basic academic capabilities. Norm-referenced measures are used to ascertain an individual's performance in…

This study examined the appropriateness of the use of criterion referenced tests as a means of controlling an individual student's advancement to the next level of instruction or retention in the current unit in the PLATO Air Force Base Computer-Based Education project at Chanute. The study was also concerned with program evaluation, which…

The 1972-73 accountability study of Duval County (Jacksonville, Florida) programs for trainable mentally handicapped (TMH) children and youth, funded under Title VI-B of the Elementary and Secondary Education Act, focused on the development and refinement of evaluation materials and field testing of the materials developed. Twelve teachers…

Review the progress and refinement of educational assessment during the past 40 years. Discusses the dynamic effects of the interaction between persons in various fields of educational practice and persons specializing in educational evaluation. Mentions adoption by the U.S. Army of psychological and educational tests for purposes of selection and…

Research evidence relating to the utility of the RMC evaluation models of compensatory education employing non-normed tests is examined. The history and evolution of five early models into the current norm-referenced model utilizing a non-normed test (Model A2), non-normed versions of a comparison model (Model B2), and the regression model (Model…