Data Envelopment Analysis (DEA) is a widely adopted non-parametric technique for evaluating R&D performance. However, traditional DEA models often struggle to provide reliable solutions in the presence of data uncertainty. To address this limitation, this study develops a novel robust super-efficiency DEA approach to evaluate R&D…

Realist evaluation (RE) is a research design increasingly used in program evaluation, that aims to explore and understand the influence of context and underlying mechanisms on intervention or program outcomes. Several methodological challenges, however, are associated with this approach. This article summarizes RE key principles and examines some…

This response aims to critically evaluate the methodology and aims of the meta-analytic review written by Maggin and Johnson (2014). The present authors systematically provide responses for each of the original criticisms and highlight concerns regarding Maggin and Johnson's methodology, while objectively describing the current state of evidence…

Shortly after we published "Addressing Flawed Research in Developmental Education" (2012) in the "Journal of Developmental Education," Thomas Bailey, Shanna Smith Jaggars, and Judith Scott- Clayton from the Community College Research Center (CCRC) wrote a response rebutting several of our claims. Though their response corrects…

This "What Works Clearinghouse Procedures and Standards Handbook (Version 3.0)" provides a detailed description of the standards and procedures of the What Works Clearinghouse (WWC). The remaining chapters of this Handbook are organized to take the reader through the basic steps that the WWC uses to develop a review protocol, identify…

Over the past few years, the focus group method has assumed a very important role as a method for collecting qualitative data in social and behavioural science research. This article elucidates theoretical and practical problems and prospects associated with the use of focus groups as a qualitative research method in social and behavioural science…

As a result of the 1998 reauthorization of Head Start, the Department of Health and Human Services conducted a national evaluation of the Head Start program. The goal of Head Start is to improve the school readiness skills of low-income children in the United States. There is a substantial body of experimental and correlational research that has…

In this article, the authors responded to nine commentaries by 17 contributors to their article, "Issues in Differential Response." The authors found that a majority of the respondents agreed with the major conclusions of "Issues in Differential Response." However, there were varying degrees of disagreement regarding the…

Differential response (DR), also referred to as alternative response (AR), family assessment response (FAR), or multiple track response, was developed to incorporate family-centered, strengths-based practices into child protective services (CPS), primarily by diverting lower risk families into an assessment track rather than requiring the…

This paper describes the analysis of the National Science Foundation (NSF) Math and Science Partnership (MSP) program's January 2008 Learning Network Conference (LNC). This study focuses on the methodologies used by the MSP community to generate evidence and seeks to understand topics of interest to the 320 LNC participants. The data set for this…

Discusses problems encountered in evaluating a mass drug education program including instrument selection, logistical constraints, and data analysis. Offers suggestions as to program evaluation improvement. (Author/RC)

Hypothesis generation and testing is outlined as an additional domain for program evaluators. Program evaluation involves a thorough analysis of the processes that contribute to change (or a lack of change) among program recipients. This process of change is analyzed in two ways: (1) treating programs as naturally occurring field studies; and (2)…

When different individuals operating in different contexts implement similar innovations, they approach the various parts of the innovation in different ways. When assessed according to the research procedures used to study innovation implementation at the Research and Development Center for Teacher Education at the University of Texas at Austin,…

Distortion and selective disclosure limit data that are available to program evaluators, producing a bias that tends to maintain the status quo. Paradoxically, attempts to objectify the data only increase the potential for distortion. Ironically, one way to encourage innovation may be to not measure it. Additional solutions are suggested.…

The General Accounting Office reviewed the Department of Labor's process for determining worker eligibility for the Trade Adjustment Assistance (TAA) program. TAA provides help in making the transition to new employment to workers certified by the Department of Labor as affected by imports. The program gives workers job counseling, occupational…