Randomized evaluations of educational technology produce log data as a bi-product: highly granular data on student and teacher usage. These datasets could shed light on causal mechanisms, effect heterogeneity, or optimal use. However, there are methodological challenges: implementation is not randomized and is only defined for the treatment group,…

The gold-standard for evaluating the effect of an educational intervention on student outcomes is running a randomized controlled trial (RCT). However, RCTs may often be small due to logistical considerations, and resulting treatment effect estimates may lack precision. Recent methods improve experimental precision by incorporating information…

The gold-standard for evaluating the effect of an educational intervention on student outcomes is running a randomized controlled trial (RCT). However, RCTs may often be small due to logistical considerations, and resulting treatment effect estimates may lack precision. Recent methods improve experimental precision by incorporating information…

Recent methods have sought to improve precision in randomized controlled trials (RCTs) by utilizing data from large observational datasets for covariate adjustment. For example, consider an RCT aimed at evaluating a new algebra curriculum, in which a few dozen schools are randomly assigned to treatment (new curriculum) or control (standard…

Background/Context: Early childhood education research has consistently found evidence of immediate, positive effects on developmental outcomes. Despite these strong initial benefits, follow-up analyses often reveal that these effects fadeout in the years following participation (e.g., Bailey et al., 2017, Clements et al., 2013; Lipsey et al.…

A randomized controlled trial was used to evaluate the impact of a frequency-building curriculum to increase the fluency of component mathematics skills in a sample of 28 males aged 9-11 years. Assessments of mathematical ability were conducted before and after the training period to evaluate the impact of learning component skills fluently on…

Many school systems are adopting new curricula in response to more rigorous standards that require higher-order thinking skills. This chapter presents implementation findings from a randomized, controlled trial of the Cognitive Tutor Geometry curriculum. We found a significant negative effect on student achievement despite the curriculum's focus…

Designing, developing, and implementing a multi-year randomized control trial targeting what works in gifted education mathematics study is challenging, at best. In response to the United States Department of Education's Institute of Education Sciences request for proposal, we carefully constructed a mixed-methods study by assembling a diverse…

Instructional design principles for visuals in student materials have been developed through findings based on student-level measures. However, teacher viewpoints may be a rich source of information to better understand how visuals can be optimized for student learning. This study's purpose is to examine teacher viewpoints on visuals. In a…

This study addresses the effectiveness of "Everyday Mathematics" (EM), a widely used core mathematics curriculum that reflects over two decades of National Science Foundation (NSF)-sponsored research and development studies (Klein, 2007; National Research Council, 2004) and aligns well with recommended policies and practices by the…

Mental abacus (MA) is a technique of performing fast, accurate arithmetic using a mental image of an abacus; experts exhibit astonishing calculation abilities. Over 3 years, 204 elementary school students (age range at outset: 5-7 years old) participated in a randomized, controlled trial to test whether MA expertise (a) can be acquired in standard…

This study used a randomized controlled trial design to investigate the ROOTS curriculum, a 50-lesson kindergarten mathematics intervention. Ten ROOTS-eligible students per classroom (n = 60) were randomly assigned to one of three conditions: a ROOTS five-student group, a ROOTS two-student group, and a no-treatment control group. Two primary…

Community colleges nationwide are looking for solutions to help students complete developmental (remedial) math--a known barrier to graduation. Some are offering computer-assisted, modular developmental math courses that allow students to earn credits incrementally and move through the curriculum at their own pace. One of these modularized…

This study drew on data from a large, randomized trial of Cognitive Tutor Algebra (CTA) in high-poverty settings to investigate how mathematics curricula and classroom achievement related to teacher reports of time spent on inquiry-based and lecture-based mathematics activities. We found that teachers using the CTA curriculum reported more time on…

Although research on the effectiveness of differentiated and enriched instruction in improving the achievement of diverse students is still emerging, some studies suggest that students in academically diverse classrooms benefited academically from differentiated learning experiences. The primary research question explored in this study was…