This response aims to critically evaluate the methodology and aims of the meta-analytic review written by Maggin and Johnson (2014). The present authors systematically provide responses for each of the original criticisms and highlight concerns regarding Maggin and Johnson's methodology, while objectively describing the current state of evidence…

In this commentary of "Evaluating the Gifted Program of an Urban School District Using a Modified Regression Discontinuity Design" by Davis, Engberg, Epple, Sieg, and Zimmer, we examine the background of the study, critique the methods used, and discuss the results and implications. The study used a fuzzy regression discontinuity design…

The report of the national response to intervention (RTI) evaluation study, conducted during 2011-2012, was released in November 2015. Anyone who has read the lengthy report can attest to its complexity and the design used in the study. Both these factors can influence the interpretation of the results from this evaluation. In this commentary, we…

Ronald Hughes, Judith Rycus, and their colleagues have produced a seminal review of differential response (DR) programs implemented across the nation. Their review questions nearly every aspect of the DR movement, beginning with the concept on which all DR programs are based and ending with serious concerns about the quality of evaluations…

This is a response to the document by Hughes et al. in this issue that offers a critique of the status of differential response (DR). We find the document to be helpful in intent, but do not find that it reflects scientifically sound methods, and contains many mischaracterizations of the status, impetus, research, and evaluation of DR to date. We…

This article is an invited commentary and analysis of the authors' completed systematic evaluation of Child Protective Services (CPS) differential response (DR) models. I write this commentary based on 25 years of public child welfare experience followed by 13 years as a social work professor and researcher. In their review of DR, the…

This reaction article highlights areas of agreement and disagreement with the study conducted by Hughes, Rycus, Saunders-Adams, Hughes, and Hughes on the current state of research and practice in differential response (DR). Overall, we agree with several of the arguments put forth by Hughes et al. regarding the limitations of DR research and the…

In this article, the authors responded to nine commentaries by 17 contributors to their article, "Issues in Differential Response." The authors found that a majority of the respondents agreed with the major conclusions of "Issues in Differential Response." However, there were varying degrees of disagreement regarding the…

This paper presents the author's comment on "Evaluation Field Building in South Asia: Reflections, Anecdotes, and Questions" by Katherine Hay. Hay raises a number of extremely relevant issues relating to evaluation field building in South Asia. In this paper, the author aims to underscore the importance of three priorities for initiating…

The papers in this dialogue help develop evaluation as a field (both in South Asia and other regions). What comes through in all of the papers is both humility of where evaluation is as a field and imagination and ambition of where evaluators could be in the near future. Reading the papers in this forum makes them enthusiastic about being…

This special series focused on treatment integrity in the child mental health and education field is timely. The articles do a laudable job of reviewing (a) the current status of treatment integrity research and measurement, (b) existing conceptual models of treatment integrity, and (c) the limitations of prior research. Overall, this thoughtful…

It is familiar in the world of systems building that funders start out saying they are not particularly interested in attribution, only to later begin using words like "prove" and "impact." Boards begin by asking for intelligent reflection from the 30,000-foot level and then suddenly want to know how many more children are ready for school.…

Are the five states that are participating in the Great Start project, in fact, off to a Great Start? The simple answer from a casual read of this excellent case study appears to be "yes." Any early learning initiative that begins with a scientific evaluation is off to a great start. Sadly, some public and private funders have begun early learning…

The concept of treatment integrity cuts across a diversity of fields involved with providing treatments or interventions to individuals. In medical treatments, the concept of "treatment compliance" or "treatment adherence" is an important and problematic issue. In the field of nutrition, the concept of "dietary adherence" is important for…

Health care and other human service programs exhibit disparities and inequalities in services and rising costs. A broader focus in program evaluation is needed. Evaluation studies should determine how well programs work as well as identify and consider alternatives. (JOW)