While regression discontinuity has usually been applied retrospectively to secondary data, it is even more attractive when applied prospectively. In a prospective design, data collection can be focused on cases near the discontinuity, thereby improving internal validity and substantially increasing precision. Furthermore, such prospective…

Research on school leadership has highlighted the impact principals have on student achievement through their influence on classroom instruction, organizational conditions, community support, and setting the teaching and learning conditions in schools. However, there is limited rigorous quantitative research on the best district policies and…

Drawing on a qualitative study of an educational reform and its external evaluation, I describe how a well-intentioned but poorly conceptualized evaluation helped perpetuate asymmetries in the generation and use of evaluation findings. This article explores this project's failure to clarify evaluator roles, identify intended users and expected…

This article illustrates the synergistic role between practice and theory in evaluation. Using reflective practice, the author reviews her own work as well as the work of other evaluators to illustrate how theory can influence practice and, in turn, how evaluation practice can inform and grow theory, especially evaluation theory. The following…

Objective: This article describes the evaluation of permanency roundtables, an intervention to help youth in foster care achieve legal permanency and the challenges evaluators faced in finding and using appropriate comparison data. Method: In 2009, permanency roundtables were conducted for 496 children in Georgia, most of whom had spent extended…

Program evaluation often suffers due to time constraints, imperfect instruments, incomplete data, and the need to report standardized metrics. This article about the evaluation process for the Wi$eUp financial education program showcases the difficulties inherent in evaluation and suggests best practices for assessing program effectiveness. We…

The paper examines the benefits claimed for action learning at individual, organisational and inter-organisational levels. It goes on to identify both generic difficulties in evaluating development programmes and action learning specifically. The distinction between formative and summative evaluation is considered and a summative evaluation…

Research on school leadership shows that principals can significantly impact student achievement by influencing classroom instruction, organizational conditions, community support and setting the teaching and learning conditions in schools. Moreover, strong principals provide a multiplier effect that enables improvement initiatives to succeed. The…

Our new report, "Keeping the Promise: Going the Distance on Transfer Reform," has found significant improvements in the creation of a seamless transfer pathway between California Community Colleges and the California State Universities (CSU) since the passage of historic transfer reform legislation, SB1440, six years ago. This report…

Background: Recent reviews suggest that many plausible programs are found to have at best small impacts not commensurate with their cost, and often have no detectable positive impacts at all. Even programs with initial rigorous impact evaluation (RIE) that show them to be effective often fail a second test with an expanded population or at…

Evaluation occurs within a specific context and is influenced by the economic, political, historical, and social forces that shape that context. The culture of evaluation is thus very much embedded in the culture of accountability that currently prevails in public sector institutions, policies, and program. As such, our understanding of the…

Ronald Hughes, Judith Rycus, and their colleagues have produced a seminal review of differential response (DR) programs implemented across the nation. Their review questions nearly every aspect of the DR movement, beginning with the concept on which all DR programs are based and ending with serious concerns about the quality of evaluations…

With increased pressure on programs to evaluate outcomes, the issue of evaluation in social work has never been so topical. In response to these pressures, there has been a growing interest in evidence-based practice and strategies for the evaluation of social work programs. The American Evaluation Association (AEA) is an international…

The Safe Schools/Healthy Students (SS/HS) national evaluation seeks to assess both the implementation process and the results of the SS/HS initiative, exploring factors that have contributed to or detracted from grantee success. Each site is required to forge partnerships with representatives from education, mental health, juvenile justice, and…

This study is a content analysis of selected federally funded leadership preparation program evaluation proposals for the 2008, 2009, and 2010 School Leadership Program grants. The United States Department of Education (USDE) began awarding funding in 2002 to develop and implement preparation programs for aspiring and current assistant principals…