This guide is intended to assist in the evaluation of career education programs. It has been developed around the concept that the evaluation should be viewed as a management tool for the improvement of program performance. The guide recognizes the key roles of the evaluators and program managers in the evaluation process. It is addressed…

A new Joint Comprehensive Evaluation System for the assessment of 15 different federal programs has been developed by the U.S. Office of Education. In this system these diverse program services will be thought of as resources available to meet the needs of critical target groups. Using this approach, a set of nine crucial questions that need to be…

The National Reporting System (NRS) established reporting requirements for the adult education program required by Title II of the Workforce Investment Act. The NRS defines the measures local programs must collect, the methodologies for collecting them, and state reporting requirements. This document presents the guidelines for conducting the NRS…

The measurement dilemmas involved in assessing the national educational goals established by the President and governors at the 1989 education summit are discussed. The first and most important choice is what to assess and whether to align assessment to the vision of curriculum reform or to the curriculum that students are actually experiencing.…

This interim report of a pilot year impact study on evaluation methodology is part of a series of documents on the evaluation of Project Developmental Continuity, a Head Start demonstration program aimed at promoting educational and developmental continuity between children's Head Start and primary school experiences. This report deals with…

Research efforts have established that the Mantel-Haenszel procedure (MHP) is an effective method for detecting the presence of test items exhibiting differential item functioning (DIF). While the MHP has been advocated for situations where item response theory based methods may not be usable, recent findings have suggested that the performance of…

The three RMC models endorsed by the U.S. Office of Education for the evaluation of Elementary and Secondary Education Act Title I programs are based on narrowly conceived approaches to evaluation--the measurement of cognitive achievement gains. Each model requires the comparison of observed student performance with an estimate of what level of…

This document is the second volume in a 5-part series that reports the results of a project undertaken to critically review and analyze major longitudinal studies of child and student development. These studies were conducted to discover the variables, techniques, methodologies, and problems pertinent to evaluate studies of the effects of schools…

The central assumption in domain-referenced testing (DRT), as presented in this book, is that a domain may be determined which adequately represents a particular universe of knowledge. After a domain has been established, the technological and practical problem of using domain-referenced testing must be solved. This book contains a collection of…

In this paper the authors illustrate the use of a strict standard for evaluating evidence on programs and strategies designed to improve outcomes for high school students. They explain what they mean by solid evidence, and present examples from multi-site evaluations of three programs. After that they examine some of the evidence on high school…

This report outlines development of a plan for assessing state and local efforts in the elimination of sex bias and discrimination in vocational education in Illinois. The first section presents in chart form the review of Department of Adult, Vocational, and Technical Education data sources on sex equity. The second section contains the Plan to…

A comprehensive assessment of the literacy proficiencies of Job Training Partnership Act (JTPA) and Employment Service/Unemployment Insurance (ES/UI) participants was conducted by the Department of Labor. The survey responses of a sample of 2,501 JTPA applicants and 3,277 ES/UI participants were scored, weighted, analyzed, and used to develop a…

Intended to provide an overview of program evaluation as it applies to the evaluation of faculty development and clinical training programs in substance abuse for health and mental health professional schools, this guide enables program developers and other faculty to work as partners with evaluators in the development of evaluation designs that…

South Carolina's School Incentive Reward Program Program (SIRP) based on year-to-year gains in reading and mathematics achievement, which seemed to have face validity, was evaluated, particularly its use of the relative gains of students in only the highest grade in the school as the basis for the awards. When this requirement was relaxed so that…

This partially annotated bibliography of journal articles, dissertations, convention papers, research reports, and a few books and unpublished manuscripts provides a comprehensive coverage of work on latent trait theory and practice. Documents are arranged alphabetically by author. The period covered ranges from the early 1950's to the present.…