A fundamental assumption of multi-tiered systems of support is the bidirectional movement of students between tiers. In comparison to research on when to intensify instruction, less attention has been paid to the validity of decisions to exit students from supplemental supports. We used data from 554 third-grade students who met the criteria to be…

Recent literature places more emphasis on assessment comments rather than relying solely on scores. Both are variable, however, emanating from assessment judgements. One established source of variability is "contrast effects": scores are shifted away from the depicted level of competence in a preceding encounter. The shift could arise…

LXD Research analyzed data from 945 students in kindergarten who were Below or Well Below Benchmark at the beginning of the year and participated in using the Phonological Awareness (PA) Lessons Deluxe Package as an intervention in CA in Fall 2021. The product is a Tier 2 or Tier 3 intervention for grades K-2 that includes lessons and…

The purpose of the study was twofold. The first purpose of the study was to determine if a correlation existed between the Standardized Test for the Assessment of Reading (STAR), created and distributed by Renaissance, and the Tennessee Comprehensive Assessment Program (TCAP) Achievement Test in Math and Reading for grade 3, grade 4, and grade 5.…

Recent simulations suggest that trend line decision rules applied to curriculum-based measurement of reading progress monitoring data may lead to inaccurate interpretations unless data are collected for upward of 3 months. The authors of those studies did not manipulate goal line slope or account for a student's level of initial performance when…

Conducting and supporting scientifically valid research activities and implementing evidence-based practices have driven recent hopes and efforts to achieve better outcomes for all students. In the context of ongoing internal review and continuous improvement, we were interested in how this evolution was reflected in empirical studies published in…

The purpose of this study was to examine the relation between "district capacity" as measured by the District Capacity Assessment (DCA) and the "initial, depth, scale," and "sustained" implementation of an evidence-based practice (EBP), Positive Behavior Interventions and Supports (PBIS). This exploratory analysis…

Most evaluators have embraced the goal of evidence-based practice (EBP). Yet, many have criticized EBP review systems that prioritize randomized control trials and use various criteria to limit the studies examined. They suggest this could produce policy recommendations based on small, unrepresentative segments of the literature and recommend a…

Since 2007, nineteen Houston Independent School District (HISD) campuses have partnered with Literacy Now to offer the Reading Intervention program. The Reading Intervention program provides individualized, small group reading tutorials for at-risk students in kindergarten to second grade to create proficient readers by the end of third grade.…

Randomized experiments have long been established as the gold standard for addressing causal questions. However, experiments are not always feasible or desired, so observational methods are also needed. When multiple observations on the same variable are available, a repeated measures design may be used to assess whether a treatment administered…

Purpose: This article provides benchmark data on within-group effect sizes from published randomized clinical trials (RCTs) supporting the efficacy of trauma-focused cognitive behavioral therapy (TF-CBT) for traumatized children. Methods: Within-group effect-size benchmarks for symptoms of trauma, anxiety, and depression were calculated via the…

In this article, we test an alternative approach to creating a counterfactual basis for estimating individual and average treatment effects. Instead of using control/comparison groups or before-measures, the so-called Counterfactual as Self-Estimated by Program Participants (CSEPP) relies on program participants' self-estimations of their own…

The goal of this paper is to provide guidance for applied education researchers in using multi-level data to study the effects of interventions implemented at the school level. Two primary approaches are currently employed in observational studies of the effect of school-level interventions. One approach employs intact school matching: matching…

In recent years, access to higher education was greatly improved through public funding. This improvement is not matched by a similar increase in graduation rate. The purpose of this study is to examine what postsecondary institutions can do to improve college freshman retention. The conceptual framework was based on research on college student…

This College Success Research Brief is one of a series of briefs documenting the implementation and impact of Mass Insight's College Success/STEM program. The research briefs are intended to share key findings, highlight ongoing questions and lines of inquiry, and inform the thinking of practitioners and policymakers on how to scale up efforts to…