This paper presents evidence confirming the validity of the RD design in the Reading Recovery study by examining the ability of the RD design to replicate the 1st grade results observed in the original i3 RCT focused on short-term impacts. Over 1,800 schools participated in the RD study over all four cohort years. The RD design used cutoff-based…

Recent studies show cluster randomized trials may be well powered to detect mediation or indirect effects in multilevel settings. However, literature has rarely provided guidance on designing cluster-randomized trials aim to assess indirect effects. In this study, we developed closed-form expression to estimate the variance of and the statistical…

Using an RD design provides statistically robust estimates while allowing researchers a different causal estimation tool to be used in educational environments where an RCT may not be feasible. Results from External Evaluation of the i3 Scale-Up of Reading Recovery show that impact estimates were remarkably similar between a randomized control…

Policymakers are increasingly interested in the extent to which experimental results generalize from a sample to a population of inference. When the sample is not randomly selected, propensity score methods are used to reweight the sample. Subclassification by propensity score is commonly used in which the population is partitioned into strata…

The Math for All (MFA) qualitative research team approached the randomized control trial (RCT) mixed methods investigation from a "pragmatic" perspective (Cresswell and Plano-Clark, 2011), that is, the belief that multiple realities can exist and that neither a qualitative nor quantitative approach is valued over the other. Further, the…

Disparities in academic science performance remain for diverse learners, including students with learning disabilities and English learners. Educational technology offers the potential to support diverse learners by taking into account their specific needs and unique strengths. This paper reports on third-year results of a 3-year randomized…

Using a low inference observation instrument, we investigated the effect of an ongoing, intensive, and structured virtual professional development [VPD] on fidelity of implementation across conditions in a randomized control trial validation study implemented in seven Texas school districts. The observations were collected three time in the…

We present main effects of treatment and moderating effects of student background on science and engineering outcomes for grades 3-5 children participating in an engineering intervention. Data is from a large-scale randomized-controlled trial of two matched pairs (intervention and comparison) of engineering units. The intervention curriculum…