Background/Context: Although the importance of facilitating transfer from community colleges to 4-year institutions is almost universally accepted, there is little consensus on how to measure transfer success or evaluate policies aimed at assisting students in making this educational transition. Despite the increasing attention on transfer in…

American national standards for the evaluation of educational programs were developed by the Joint Committee on Standards for Educational Evaluation in 1994. This paper describes the Joint Committee's standard setting process. The Joint Committee is a coalition of professional organizations concerned with the quality of evaluations in education.…

This chapter addresses the problems encountered in the formative evaluation of instructional development projects and the instructional development process. Three types of formative evaluation--component, convergent, and contextual--are distinguished, and the consequences of using the wrong type of evaluation in a particular situation or project…

Factors that influence the effectiveness of program evaluation in higher education and eight recommendations for program evaluation are considered. Currently, program evaluation is characterized by negotiation because of three powerful concepts: the nature of multiple constructions and multiple realities; the influence of power distributions…

Recent methodological advances are described that enable the analyst to extract additional information from the data envelopment analysis (DEA) methodology, including goal programming to develop cross-efficiencies, cluster analysis, analysis of variance, and pooled cross section time-series analysis. Some shortcomings of DEA are discussed. (LMO)

This document provides some guidance to those who are exploring the connections between service-learning and evaluation. Categories are defined in the document by highlighting the following seven questions: (1) What do I need to know about the important issues involved in evaluating my service-learning program? (2) Do you have a model of…

School-linked services are one program approach seeking to address concerns about fragmented and duplicative services by offering the school site as a single point of entry. Most of these programs display a holistic approach to children, joint planning, shared service delivery, and collaboration or coordination. Determining how school-linked…

The "CSE Program Evaluation Kit" is a series of nine books intended to assist people conducting program evaluations. This volume, the third in the kit, discusses the logic underlying the use of quantitative research designs, including the pretest-posttest design, and supplies step-by-step procedures for setting up and interpreting the…

Reviews the state of the art in performance measures and assessment processes in program evaluation before the passage of the Government Performance and Results Act (GPRA), and discusses difficulties in fitting these practices into the GPRA format. Presents a simple logic model for evaluating research programs. (SLD)

Based on experiences in conducting program evaluations for the Canadian Federal Government, an evaluator addresses reconciliation of the information needs of managers and accountability. External and internal accountability are covered. Using the perspectives of both line managers and senior managers, means of resolving pertinent issues are…

The role of evaluation in electric utility demand-side management (DSM) programs is explored, including the importance of evaluation in determining financial incentives that a company will earn for DSM programs. A hypothetical example is presented of the types of problems that might arise when evaluations are subject to litigation. (SLD)

Six potential problems with the use of randomized experiments to evaluate programs in the field are addressed. Problems include treatment dilution, treatment contamination or confounding, inaccurate case flow and power estimates, violations of the random assignment processes, changes in the environmental context, and changes in the treatment…

The impact of a newly instituted prime vendor (wholesaler) pharmaceutical system at Veterans Affairs (VA) hospitals was studied at 33 VA centers and 32 matched comparison hospitals. Results indicate satisfaction with the new system and illustrate the solutions to some interesting evaluation problems. (SLD)

This essay provides some background on, explanation of, and justification of a theoretical framework for all types of evaluation. This framework is used to connect and underpin the approaches of other contributors to this special issue. A core discipline of evaluation is proposed that ties assorted evaluation fields together. (SLD)

Describes two evaluation studies that faced ethical problems because of an atmosphere of promotion and advocacy. One was the evaluation of a teachers' professional-development program, and the other was an evaluation of a federally funded youth sports program. The realization and resolution of ethical conduct must come from within the evaluator.…