Design-based methods have recently been developed as a way to analyze randomized controlled trial (RCT) data for designs with a single treatment and control group. This article builds on this framework to develop design-based estimators for evaluations with multiple research groups. Results are provided for a wide range of designs used in…

Design-based methods have recently been developed as a way to analyze data from impact evaluations of interventions, programs, and policies (Freedman, 2008; Lin, 2013; Imbens and Rubin, 2015; Schochet, 2013, 2016; Yang and Tsiatis, 2001). The non-parametric estimators are derived using the building blocks of experimental designs with minimal…

Varying methods for evaluating the outcomes of single case research designs (SCD) are currently used in reviews and meta-analyses of interventions. Quantitative effect size measures are often presented alongside visual analysis conclusions. Six measures across two classes--overlap measures (percentage non-overlapping data, improvement rate…

This empirical study contributes to the dialogue about quality leadership and national trends involving standards-based program review. It is the first to utilize the 2016 Council for the Accreditation of Educator Preparation (CAEP) Standards for graduate programs and separately from accreditation and sponsorship. The literature on quality…

Increasingly, researchers are interested in questions regarding treatment-effect variation across partially or fully latent subgroups defined not by pretreatment characteristics but by postrandomization actions. One promising approach to address such questions is principal stratification. Under this framework, a researcher defines endogenous…

Background: Diabetes self-management education (DSME) is generally considered to be a key determinant of the treatment outcomes and related costs of diabetes mellitus. While DSME programmes generally have positive outcomes, their effects may depend on certain factors, such as the type of programmes provided and patients' level of health literacy…

Traditionally, evaluation has primarily tried to answer the question "Does a program, service, or policy work?" Recently, more attention is given to questions about variation in program effects and the mechanisms through which program effects occur. Addressing these kinds of questions requires moving beyond assessing average program…

Recent meta-analyses of the effectiveness of token economies (TEs) report insufficient quality in the research or mixed effects in the results. This study examines the contemporary (post-Public Law 94-142) peer-reviewed published single-case research evaluating the effectiveness of TEs. The results are stratified across quality of demonstrated…

Background: The YMCA of USA has adopted Healthy Eating and Physical Activity (HEPA) Standards for its afterschool programs (ASPs). Little is known about strategies YMCA ASPs are implementing to achieve Standards and these strategies' effectiveness. Aims: (1) Identify strategies implemented in YMCA ASPs and (2) evaluate the relationship between…

Purpose: Prevention advocates work hard to create and deliver sexual assault awareness programs on college campuses, including Christian universities. To do so requires savvy planning and a high degree of cultural competence, as a review of the literature indicates that some Christian campuses shy away from the topic and refuse to allow needed…

Despite growing calls for more accountability of teacher education programs (TEPs), there is little consensus about how to evaluate them. This study investigates the potential for using observational ratings of program completers to evaluate TEPs. Drawing on statewide data on almost 9,500 program completers, representing 44 providers (183…

Hoping to spur dramatic school turnaround, the federal government channeled resources to the country's lowest-performing schools through School Improvement Grants (SIG). However, prior research on SIG effectiveness is limited and focuses primarily on student achievement. This study uses a difference-in-differences strategy to estimate program…

Hoping to spur dramatic school turnaround, the federal government channeled resources to the country's lowest-performing schools through School Improvement Grants (SIG). However, prior research on SIG effectiveness is limited and focuses primarily on student achievement. This study uses a difference-in-differences strategy to estimate program…

The authors conducted a meta-analysis and systematic review that examined 23 studies evaluating the effectiveness of child centered play therapy (CCPT) conducted in elementary schools. Meta-analysis results were explored using a random effects model for mean difference and mean gain effect size estimates. Results revealed statistically significant…

Background: This paper builds on a Cochrane-Campbell systematic review of interventions that reduce harms and promote reintegration in street-connected children and young people focusing on intervention outcomes. The aim of the present analysis is to explore questions raised in the systematic review over the potential role of service engagement in…