Purpose: The purpose of this project was (1) to collaborate with public preschool programs to adapt, test, and revise the implementation model of an innovative early mathematics intervention, "Pre-K Mathematics" and (2) to determine whether this model makes it possible for local programs to sustain their implementation without reducing…

Background: To understand and apply the results of multisite impact studies, it is necessary to know the extent to which the components of an intervention were implemented as they were designed in each context (e.g., Carroll et al., 2007; Hill, Corey, & Jacob, 2018). Rigorous and cost-effective measures of implementation fidelity can help…

Background: A large evidence base suggests that without effective early intervention, young children who exhibit persistent challenging behavior often face a host of long-term social and academic challenges (Bulotsky-Shearer & Fantuzzo, 2011; Hauser-Cram & Woodman, 2016; Kazdin, 1995; Lane et al., 2008; Miller et al., 2017). Challenging…

Meeting the What Works Clearinghouse (WWC) attrition standard (or one of the attrition standards based on the WWC standard) is now an important consideration for researchers conducting studies that could potentially be reviewed by the WWC (or other evidence reviews). Understanding the basis of this standard is valuable for anyone seeking to meet…

Often, in the case of experimental evaluations of multifaceted interventions, researchers and policymakers alike are interested in asking not only whether a given intervention had an effect but also why. They seek answers to questions such as: What features of the intervention led to the impacts that we have observed, or what was the causal…

The Recognition & Response (R&R) model was developed and is being validated by a research team at the FPG Child Development Institute at the University of North Carolina at Chapel Hill. R&R has generated widespread attention in the early childhood field as a promising RTI model for pre-k (see entire issue of NHSA Dialog, Volume 12[3],…

Single-case or single-subject experimental designs (SSED) are used to evaluate the effect of one or more treatments on a single case. Although SSED studies are growing in popularity, the results are in theory case-specific. One systematic and statistical approach for combining single-case data within and across studies is multilevel modeling. The…

Estimates of fidelity of implementation are essential to interpret the effects of educational interventions in randomized controlled trials (RCTs). While random assignment protects against many threats to validity, and therefore provides the best approximation to a true counterfactual condition, it does not ensure that the treatment condition…

This presentation reports on the goals and preliminary outcomes of the Child-Parent Centers (CPC) Expansion Project, which is a PreK to 3rd grade school reform model aimed at improving the short- and long-term outcomes of participating children and families. The model provides continuous education and family support services to schools serving a…

This randomized control study compares the efficacy of two response-to-intervention (RTI) models: (1) Dynamic RTI, which immediately refers grade 1 students with the weakest skills to the most intensive intervention supports (Tier 2 or Tier 3); and (2) Typical RTI, which starts all students in Tier 1 and after 8 weeks, decides whether students who…

Assessing fidelity of implementation is becoming increasingly important in education research, in particular as a tool for understanding variations in treatment effectiveness. Fidelity of implementation is defined as "the determination of how well an intervention is implemented in comparison with the original program design during an efficacy…

One of the vexing problems in the analysis of SSD is in the assessment of the effect of intervention. Serial dependence notwithstanding, the linear model approach that has been advanced involves, in general, the fitting of regression lines (or curves) to the set of observations within each phase of the design and comparing the parameters of these…

Recently, the authors have been exploring the use of propensity score methods for developing evidence of program impact. Specifically, they have been developing evidence (after one year of implementation) of the effects of the Math Science Partnership in New York City ("MSPinNYC2") on high school students' achievement--both in terms of…

Data from single case designs (SCDs) have traditionally been analyzed by visual inspection rather than statistical models. As a consequence, effect sizes have been of little interest. Lately, some effect-size estimators have been proposed, but most are either (i) nonparametric, and/or (ii) based on an analogy incompatible with effect sizes from…

The early identification of students at-risk for future reading difficulty has become a focal point for K-12 stakeholders seeking to actively prevent the emergence of student reading deficits. Early and active intervention efforts for struggling readers have taken on greater urgency given the accountability pressures that stem from the No Child…