Evaluators who perform formative evaluations would be well served to apprise themselves of recent survey research in framing formative evaluations. Illustrative examples are used from research into such diverse areas of activity as: the development of identities attached to different forms of modern rock and roll; the rationales that juvenile…

Two specific methods of analysis in large-scale evaluations are considered: structural equation modeling and selection modeling/analysis of non-equivalent control group designs. Their utility in large-scale educational program evaluation is discussed. The examination of these methodological developments indicates how people (evaluators,…

This report focuses on a set of supplemental analyses that were performed on portions of the Emergency School Aid Act (ESAA) evaluation data. The goal of these analyses was to explore additional relationships in the data that might help to inform program policy, to confirm and/or further explicate some of the findings reported earlier, and to put…

The project summarized here focuses on the interpretability of vocational education outcome data. The booklet first covers the project problem and background, project objectives, general plan of operation, and the analysis of extant data bases in vocational education. It then discusses a case study of differences in job placement rates reported by…

The purpose of this paper is to encourage the reader to distinguish between evaluation and other information-gathering procedures, to distinguish between measures of efficiency and effectiveness, and to make informed decisions about when to use evaluation rather than another procedure for producing information about a project. Material is divided…

This manual is a beginning guide to program evaluation. Designed for program evaluators who have little or no previous experience in manipulating data, this guide is designed to demonstrate how to evaluate different aspects of a vocational rehabilitation program--and use those findings for program improvement. The use of averages, percentages, and…

The report examines the potential of Social Security Administration data for manpower training evaluation. It assesses the utility of SSA data for comparing the economic gains of on-the-job training and institutional trainees before and after training. The methodology developed incorporates multiple correlation analysis, analysis of variance, and…

Six principles for statewide assessment are discussed: (1) involve the community; (2) specify and define goals; (3) use measuring devices with face and content validity; (4) take noncognitive effects of school into account; (5) design data presentation for lay understanding; and (6) do not let assessment be an end in itself. Decisions to be made…

A report to provide information which can improve the ability of a district to evaluate its performance is presented. The report is also intended as an interpretive document for those school districts receiving individualized performance profiles. Information is presented on scales which show the percentile rank of a particular district relative…

Based on a theoretical model of program development, this taxonomy of evaluation relates six evaluation objectives or purposes to nine methodological alternatives. Use of the taxonomy may increase the efficiency of evaluation, improve communication, and assist in the choice of a methodology that is appropriate to the evaluation purposes.…

The evaluators of the Emergency School Aid Act respond to commentaries on their evaluation of the act and their article detailing that evaluation (TM 503 672). Each commentary is discussed. (See TM 503 673 through 678). (JKS)

Outlines problems with the U. S. Office of Education sponsored report on Project Follow Through. The problems are in the areas of classification of models, measurement techniques, methods of analysis, and fairness. (Author/IRT)

The research appraisal checklist, which contains 51 criteria ordered under 8 major research categories, is examined as a method of appraising a nursing research report. Criteria include title, abstract, problem, review of literature, methodology (subjects, instruments, design), data analysis, discussion, and form and style. (CT)

Two examples illustrate effective use of evaluation offices. The first, a centralized approach, involves goal setting, followed by measurement techniques and improvement based on data. The second, decentralized approach involves reduction of data to six profiles, which form the basis of planning. Similarities and differences are discussed. (TE)

This handbook is designed to help beginning evaluators of teacher recruitment programs. It addresses the information and assessment needs of teacher recruitment programs. It takes a hands-on approach and includes worksheets and instructions for using them. After presenting tips for getting started, the handbook offers eight steps to successful…