The purpose of this evaluation was to examine the impact of i-Ready Personalized Instruction that met Curriculum Associates' recommended usage levels on ELA achievement, as measured by the Massachusetts Comprehensive Assessment System (MCAS) ELA assessment. This study compared the ELA achievement growth in the 2020-21 school year of students who…

The purpose of this paper is to showcase new research that seeks to provide guidance on the heterogeneity of treatment effects by utilizing the variance of demographic differences in state assessments. This study is focused on a simple randomized block design where students are nested within schools, and within each school students are randomized…

Reading comprehension growth trajectories from 3rd to 7th grade were estimated for 99,919 students on a state reading comprehension assessment. We examined whether differences between students in general education (GE) and groups of students identified as exceptional learners were best characterized as stable, widening, or narrowing. The groups…

This study examined mathematics achievement growth of students without disabilities (SWoD) and students with learning disabilities (LD) and tested whether growth and LD status interacted with student demographic characteristics. Growth was estimated in a statewide sample of 79,554 students over Grades 3 to 7. The LD group was significantly lower…

This study examines the use of cross-classified random effects models (CCrem) and cross-classified multiple membership random effects models (CCMMrem) to model rater bias and estimate teacher effectiveness. Effect estimates are compared using CTT versus item response theory (IRT) scaling methods and three models (i.e., conventional multilevel…

Content area reading comprehension and writing have been a challenge for children in the U.S. schools for many years as evidenced by state and national assessments. One promising solution to the problem is text structure based instruction that promotes strategic selection, encoding, retrieval, and use of information for myriads of activities…

This article examines the relationship between after-school program quality, program attendance, and academic outcomes for a sample of low-income after-school program participants. Regression and hierarchical linear modeling analyses use a unique longitudinal data set including 29 after-school programs that served 5,108 students in Grades 4 to 8…

Objectives: Group-randomized designs are well suited for studies of professional development because they can accommodate programs that are delivered to intact groups (e.g., schools), the collaborative nature of professional development, and extant teacher/school assignments. Though group designs may be theoretically favorable, prior evidence has…

Educators have long used test scores to make educational decisions, but only within the last decade has the availability of data been systematic (Abelman, Elmore, Even, Kenyon, & Marshall, 1999). In recent years, interest has spiked in data-driven decision making in education (Marsh, Pane, & Hamilton, 2006). With technological advances and…

Background: Cluster-randomized experiments that assign intact groups such as schools or school districts to treatment conditions are increasingly common in educational research. Such experiments are inherently multilevel designs whose sensitivity (statistical power and precision of estimates) depends on the variance decomposition across levels.…

The current study examines data from students in grades 4-8 who participated in a statewide computer-based benchmark writing assessment that featured automated essay scoring and automated feedback. We examined whether the use of automated feedback was associated with gains in writing quality across revisions to an essay, and with transfer effects…