This article presents methods for using extant data to improve the properties of estimators of the standardized mean difference (SMD) effect size. Because samples recruited into education research studies are often more homogeneous than the populations of policy interest, the variation in educational outcomes can be smaller in these samples than…

This article presents methods for using extant data to improve the properties of estimators of the standardized mean difference (SMD) effect size. Because samples recruited into education research studies are often more homogeneous than the populations of policy interest, the variation in educational outcomes can be smaller in these samples than…

Conducting research with human subjects can be difficult because of limited sample sizes and small empirical effects. We demonstrate that this problem can yield patterns of results that are practically indistinguishable from flipping a coin to determine the direction of treatment effects. We use this idea of random conclusions to establish a…

Assessing sensitivity to unmeasured confounding is an important step in observational studies, which typically estimate effects under the assumption that all confounders are measured. In this paper, we develop a sensitivity analysis framework for balancing weights estimators, an increasingly popular approach that solves an optimization problem to…

Presenting novel numbers about climate change to people after they estimate those numbers can shift their attitudes and scientific conceptions. Prior research suggests that such science learning can be supported by encouraging learners to make use of given benchmark information, however there are several other numerical estimation skills that may…

According to NCTM's "Principles and Standards for School Mathematics" (2000), the act of estimating is reflective of students' mathematical intuition and number sense. Students with more developed number sense are better able to judge the reasonableness of their results. To promote estimation, Jennifer Marshall explored incorporating…

This study analyzed the relationship between benchmark scores from the newly published Dynamic Indicators of Basic Early Literacy Skills Math (i.e., Acadience™) math probes and student performance on math and reading sections of a state-mandated high-stakes test. Participants were 420 students enrolled in third, fourth, and fifth grades in a rural…

Effect sizes in the Cohen's d family are often used in education to compare estimates across studies, measures, and sample sizes. For example, effect sizes are used to compare gains in achievement students make over time, either in pre- and post-treatment studies or in the absence of intervention, such as when estimating achievement gaps. However,…

Purpose: We examine the impact of advice given by extension agents to Ethiopian farmers, as perceived by the farmers themselves. Design/methodology/approach: Using survey data from 2014, we analyze the perceived impact of advice on farmers' incomes and crop yields. We use a bootstrapped instrumental variable (IV) estimator and the conditional…

Randomized experiments are considered the gold standard for causal inference because they can provide unbiased estimates of treatment effects for the experimental participants. However, researchers and policymakers are often interested in using a specific experiment to inform decisions about other target populations. In education research,…

This study tested whether second graders use benchmark-based strategies when solving a number line estimation (NLE) task. Participants were assigned to one of three conditions based on the availability of benchmarks provided on the number line. In the bounded condition, number lines were only bounded at both sides by 0 and 200, while the midpoint…

This study analyzed the relationship between benchmark scores from two curriculum-based measurement probes in mathematics (M-CBM) and student performance on a state-mandated high-stakes test. Participants were 298 students enrolled in grades 7 and 8 in a rural southeastern school. Specifically, we calculated the criterion-related and predictive…

When randomized control trials (RCT) are not feasible, researchers seek other methods to make causal inference, e.g., propensity score methods. One of the underlined assumptions for the propensity score methods to obtain unbiased treatment effect estimates is the ignorability assumption, that is, conditional on the propensity score, treatment…

School administrators across the nation are actively searching for solutions to increase student achievement due in part to the significant amount of knowledge that is lost annually each summer. Mathematical computation skills are especially at-risk. This quantitative research study was designed to investigate the impact of summer recess also…

Recent research on annual growth measured using curriculum-based measurement (CBM) indicates that growth may not be linear across the year and instead varies across semesters. Numerous studies in reading have confirmed this phenomenon with only one study of math computation yielding a similar finding. This study further investigated the presence…