Introduction: The What Works Clearinghouse (WWC) reviews rigorous research on educational interventions with a goal of identifying "what works" and making that information accessible to educators and policymakers. In rating the quality of causal research, the WWC has historically prioritized internal validity over external validity. One…

Background: Gaming the system -- attempting to progress through a learning activity without learning (R. Baker et al., 2008) -- is an enduring problem that reduces the efficacy of Computer Based Learning Platforms (CBLPs). Researchers made substantial progress in identifying instances when students are gaming the system (Baker et al., 2006; Dang…

I. Purpose of the Study: Detecting whether interventions work or not (through main effect analysis) can provide empirical evidence regarding the causal linkage between malleable factors (e.g., interventions) and learner outcomes. In complement, moderation analyses help delineate for whom and under what conditions intervention effects are most…

Background/Context: Technology in education has become a vital part of modern education systems (Turugare & Rudhumbu, 2020, Osterweil et. al, 2015; Ghory & Ghafory, 2021). Over the past two decades, it has transformed the way we teach, learn, and assess knowledge (U.S. Department of Education Office of Educational Technology, 2017; Partala…

Background: The data revolution in education has led to more data collection, more randomized controlled trials (RCTs), and more data collection within RCTs. Often following IES recommendations, researchers studying program effectiveness gather data on how the intervention was implemented. Educational implementation data can be complex, including…

Background: The landscape of education is increasingly recognizing the impactful role of Career and Technical Education (CTE) programs in preparing students for the workforce. In Delaware, the implementation of CTE programs has been substantial, offering students opportunities to earn college credits, attain industry certifications, and gain…

Background: The past half-century has resulted in a substantial expansion of early childhood center-based care in the United States. Today, over 74% of American children aged 3-5 attend center-based care (U.S. Department of Education, National Center for Education Statistics, 2021). Although public pre-k is considered socially favorable,…

Background: Implementation quality is a significant factor in determining whether a program has its intended impact (Durlak and DuPre, 2008; List et al., 2021). Therefore, when studying a program's efficacy, researchers must ensure that the program is implemented as intended to estimate its impact. To evaluate whether a program is being…

Purpose: The purpose of this project was (1) to collaborate with public preschool programs to adapt, test, and revise the implementation model of an innovative early mathematics intervention, "Pre-K Mathematics" and (2) to determine whether this model makes it possible for local programs to sustain their implementation without reducing…

Background: Over the past decade, schools across the United States increasingly turned to online learning (Gemin, Pape, Vashaw, & Watson, 2015; Queen & Lewis, 2011). While many espouse the promise of online credit recovery (OCR) courses, the abrupt shift to online learning during the COVID-19 pandemic renewed concerns about theses courses'…

Background/Context: In the early elementary grades, many students do not achieve literacy proficiency due to inadequate personalized literacy instruction (Taylor et al., 2010). Despite increasing evidence that differentiated instruction informed by assessments of students' reading abilities can improve learning more effectively than…

Background/Context: There has been a growing realization in American education that the traditional focus on academics, particularly mathematics and English language arts, is insufficient to guarantee success in the modern workforce and society (Griffin and Care, 2015). Educators, policymakers, and researchers have correspondingly broadened the…

Background/Context: Observational studies often employ regression discontinuity (RD) designs and multiple control-group designs to explore the causal quantities of interest. RD designs assess policy and program effectiveness by assigning subjects to treatment based on whether they exceed a pre-defined cutoff. RD designs are classified into two…

Background/Context: The U.S has experienced years of lost progress in math because of the COVID-19 pandemic (NAEP, n.d.a). Fraction understanding is widely characterized as the gatekeeper to algebra (Booth et al., 2012; National Mathematics Advisory Panel, 2008) and can support success in middle and high school math (Bailey et al., 2012; Booth et…

Background: Education plays a pivotal role in empowering individuals with the knowledge and skills needed for careers, economic progress, and societal engagement. Dropping out of school before achieving a qualification undermines these opportunities and has an impact on individuals and society (Audit Commission, 2010; OECD, 2023). International…