While legislative oversight offices, like many evaluation and policy analysis units, face substantial challenges in promoting use of their work by policymakers, they often have not taken steps to overcome these challenges by adopting the strategies suggested by the evaluation literature. Although the offices seek utilization, they have not fully…

Purpose: The use of e-learning is largely predicated upon the assumption that it can facilitate improvements in student learning and therefore can be more effective than conventional techniques. This assumption has been supported by some in the literature but has been questioned by a continuing body of contrary or indifferent evidence. The purpose…

Although the need for evaluation of prevention programs is clear, the implementation of evaluation, particularly for large, complex projects with multiple investigators, poses numerous challenges. Program evaluators in these circumstances do not have the same degree of control as, say, experimental psychologists and must find ways to obtain data…

In compliance with California's Proposition 10 (Children and Families First Act), county commissions are being asked to monitor what differences the family support programs they are funding are making in the lives of the children and families they serve. Each commission has the responsibility of selecting a set of indicators to measure the impact…

This digest describes some of the basic logic-of-evaluation skills and some of the basic methodological skills that need to be mastered in order to practice the art and science of evaluation. Some topics from the logic of evaluation that must be dealt with include understanding : (1) the differences and connections between evaluation and other…

Findings from an outcome evaluation of the California AIDS Education and Prevention Program, the largest of its kind in the country, are presented. Specific programs suffered from design defects that made it impossible to accurately determine their effectiveness. Attitude and behavior change was not properly addressed by the programs. (TJH)

Kirkpatrick's highly popular model of training evaluation criteria proposed four ascending, causally related, and positively intercorrelated levels: reactions, learning, behavior, and results. This article examines the validity of the three problematic assumptions of the model, the frequency of each level in published evaluation studies,…

Describes the Special Supplemental Nutrition Program for Women, Infants, and Children (WIC) and reviews and assesses research on its impact. Recommends policy reforms and randomized experiments to evaluate the program and any changes made to it. Weaknesses in research to date make the real impacts of WIC unclear. (Contains 79 references.) (SLD)

Chelimsky, former head of the Program Evaluation and Methodology Division of the General Accounting Office, suggested that advocacy by evaluators destroys their credibility. Evaluators should, this author argues, be advocates for democracy and the public interest, with the question being how explicitly and how defensibly. (SLD)

Describes recent developments in United Kingdom politics that have affected development of evidence-based policy for children. Examines the notion of "what works," leading to a suggestion that evaluators be concerned with "what is worth doing" for children. Considers robustness as a guiding principle for evaluation design and…

The Comparing Options in Secondary Mathematics: Investigating Curriculum (COSMIC) project is a longitudinal study of student learning from two types of mathematics curricula: integrated and subject-specific. Previous large-scale research studies such as the National Assessment of Educational Progress (NAEP) indicate that numerous variables are…

How can indigenous evaluators implement culturally competent models in First Nations communities while ensuring that government grant evaluation requirements are met? Through describing the challenges in one tribal community in the United States, this article will discuss how American Indian/Alaska Native substance abuse prevention programs are…

The issue of evaluation in adult literacy is addressed in this paper. It is assumed that evaluation is a necessary and vital function in an adult literacy program because it helps administrators understand their efforts, increases information available about a program's functioning, builds an image, and facilitates the discovery of information on…

It has been two years since the Evaluation Research Society (ERS) published its Standards for Program Evaluation. The standards have influenced professional activities, such as panel discussions, and have been useful in training evaluators. However, the question arises as to whether the standards have been consulted by practicing evaluators or…

Strategies for use by clients who commission evaluation studies in the private, university, or governmental sector are outlined. Topics covered include establishing the purpose of the evaluation, assembling in-house management staff, specifying work and expertise requirements, establishing confidentiality and project control, and managing results.…