In educational contexts, students often self-select into specific interventions (e.g., courses, majors, extracurricular programming). When students self-select into an intervention, systematic group differences may impact the validity of inferences made regarding the effect of the intervention. Propensity score methods are commonly used to reduce…

Field experiments in education frequently assign entire groups such as schools to treatment or control conditions. These experiments incorporate sometimes a longitudinal component where for example students are followed over time to assess differences in the average rate of linear change, or rate of acceleration. In this study, we provide methods…

This study applied systematic meta-analytic procedures to summarize findings from experimental and quasi-experimental investigations into the effectiveness of using the tools and techniques of corpus linguistics for second language learning or use, here referred to as data-driven learning (DDL). Analysis of 64 separate studies representing 88…

A common assumption in meta-analysis is that effect sizes are independent. When correlated effect sizes are analyzed using traditional univariate techniques, this assumption is violated. This research assesses the impact of dependence arising from treatment-control studies with multiple endpoints on homogeneity measures "Q" and…

This article examines changes in the research design, sample size, and precision between the planning phase and implementation phase of group randomized trials (GRTs) funded by the Institute of Education Sciences. Thirty-eight GRTs funded between 2002 and 2006 were examined. Three studies revealed changes in the experimental design. Ten studies…

Field experiments that involve nested structures frequently assign treatment conditions to entire groups (such as schools). A key aspect of the design of such experiments includes knowledge of the clustering effects that are often expressed via intraclass correlation. This study provides methods for constructing a more powerful test for the…

In this article, the authors address the practicalities of how data should be presented, summarized, and interpreted. There are no exact rules; indeed there are valid concerns that exact rules may be inappropriate and too prescriptive. New procedures evolve, and new methods may be needed to deal with new types of data, just as people know that new…

This paper includes a nontechnical description of methods for calculating effect sizes in intellectual and developmental disability studies. Different hypothetical studies are used to illustrate how null hypothesis significance testing (NHST) and effect size findings can result in quite different outcomes and therefore conflicting results. Whereas…

The continuous change characterizing 21st century society has significant implications for higher education. Educators and business leaders increasingly recognize that education within and preparation for a context of change requires learning environments fostering openness, flexibility, and engagement with other ideas and people. Such…

Childhood obesity trends have increased dramatically over the past three decade's. The purpose of this quantitative systematic review is to provide an update of the evidence, illustrating the efficacy of childhood obesity treatment, considering whether treatment fidelity has been measured and/or reported and whether this related to the treatment…

This "What Works Clearinghouse Procedures and Standards Handbook (Version 3.0)" provides a detailed description of the standards and procedures of the What Works Clearinghouse (WWC). The remaining chapters of this Handbook are organized to take the reader through the basic steps that the WWC uses to develop a review protocol, identify…

Do interventions work and for whom? For this article, we examined the influence of population heterogeneity on power in designing and evaluating interventions. On the basis of Monte Carlo simulations in Study 1, we demonstrated that the power to detect the overall intervention effect is lower for a mixture of two subpopulations than for a…

This article summarizes the creation and implementation of a concurrent support class for TRS 92--Intermediate Algebra, a developmental mathematics course at Fort Lewis College in Durango, Colorado. The concurrent course outlined in this article demonstrates a statistically significant increase in student success rates since its inception.…

Clinical psychology practices initially grew through the use of case studies, uncontrolled trials, and eventually through randomized controlled trials (RCTs). The use of a wait-list control group is standard practice in such trials of treatment regimens for psychopathological conditions. However, as knowledge advances regarding the successful…

The authors' purpose was to explore the effects of a supplementary, guided, silent reading intervention with 80 struggling third-grade readers who were retained at grade level as a result of poor performance on the reading portion of a criterion referenced state assessment. The students were distributed in 11 elementary schools in a large, urban…