The past few years have seen efforts in several countries and a wide range of disciplines to adopt and apply existing professional standards for guiding and judging evaluation services and/or develop new standards. Some of the efforts have drawn from the work and products of the North American Joint Committee on Standards for Educational…

This article provides a critical review of the quality of 12 recent large federal program evaluations. The review focused on elements of the evaluation design, inclusion of evaluation expertise among those who have oversight of the evaluation, and evaluation dissemination. Overall, the process analyses from these evaluations provide good models…

This article addresses the construction of "critical friendships" within the practice of one particular program evaluation. It focuses on the evolution of relationships developed during one 2-year program evaluation study that examined a collaborative educational project. Findings show that a caring interest and mentoring rapport developed between…

Evaluation can be a complicated, time-consuming process. It is no wonder so many organizations resist doing it. In this article, the author outlines the steps in the evaluation process and presents sample questions in each step. The author also defines and exemplifies the components for a successful evaluation strategy.

Fidelity may be defined as the extent to which delivery of an intervention adheres to the protocol or program model originally developed. Fidelity measurement has increasing significance for evaluation, treatment effectiveness research, and service administration. Yet few published studies using fidelity criteria provide details on the…

Empowerment evaluation involves a program's stakeholders in designing and implementing an evaluation of their own program, thus contributing to the program's improvement and self-determination (Fetterman, 1994, 1996). It appeared to be an appropriate approach for evaluating a mental health drop-in center, which had congruent goals of collaboration…

Decision makers in nonformal education programs can maximize the utility of their evaluation investment and improve program effectiveness by being more mindful of the potential uses of evaluation information. Evaluation use is a multifaceted construct that may include, but is not limited to, the implementation of evaluation recommendations or…

To provide another perspective on evaluation within nonformal settings, "New Directions for Evaluation" recently interviewed David Smith, the coordinator of the Professional Learning to Close the Achievement Gap program for the Kansas City, Kansas, Public Schools, who has extensive background in education and educational research. He formerly held…

This study compares the Commission on Accreditation for Health Informatics and Information Management Education (CAHIIM) Board of Commissioner and Panel of Accreditation Reviewer understanding of what constitutes student learning outcomes and an effective program evaluation plan with that of campus-based health information technology (HIT) program…

This report is a product of an European Association for Quality Assurance in Higher Education (ENQA) Workshop "Assessing educational quality: Knowledge production and the role of experts" hosted by the Norwegian Agency for Quality Assurance in Education (NOKUT) in Oslo in February, 2008. The workshop gathered representatives from higher…

In response to the current federal initiative to evaluate the impact of the Individuals with Disabilities Education Act Personnel Preparation program, the authors summarize prior efforts to evaluate the program and identify common themes and gaps in that work. Also, the authors pose issues and questions for those who seek to understand the impact…

Treatment integrity (also referred to as "treatment fidelity," "intervention integrity," and "procedural reliability") is an important methodological concerning both research and practice because treatment integrity data are essential to making valid conclusions regarding treatment outcomes. Despite its relationship to validity, treatment…

The Louisiana Board of Regents is the first in the nation to publicly use a performance model based upon the achievement of students in grades 4-9 as one of several measures to examine the effectiveness of teacher preparation programs. The State has supported the development and implementation of a Value Added Teacher Preparation Assessment Model…

The PD program evaluated in this study is designed to address the problem of low student achievement in topics in rational numbers. The study focuses on seventh grade, the culminating year for teaching those topics. The study randomly assigned 77 mid- and high-poverty schools from 12 districts to treatment and control conditions and collected…

This study focuses on how the treatment effects of a teacher professional development initiative in science differed by school capacity. In other words, the authors are primarily concerned with treatment effect heterogeneity. As such, this paper complements ongoing evaluation of the average treatment effects of the initiative over time. The…