Toward the goal of more rapid knowledge accumulation via better meta-analyses, this article explores statistical approaches intended to increase the precision and comparability of effect sizes from education research. The featured estimate of the proposed approach is a standardized mean difference effect size whose numerator is a mean difference…

Education is a complex system, which has conceptual and methodological implications for education research and policy. In this article, an overview is first provided of the Complex Systems Conceptual Framework for Learning (CSCFL), which consists of a set of conceptual perspectives that are generally shared by educational complex systems,…

Cost, cost-effectiveness, and benefit-cost analysis are methods used by economists to evaluate public policies. Essentially, these methods rely on impact evaluations, that is, research studies of efficacy and effectiveness. However, in most research in education, these cost and impact evaluations are performed separately. This separation creates…

Experience-sampling methods (ESM) enable us to learn about individuals' lives in context by measuring participants' feelings, thoughts, actions, context, and/or activities as they go about their daily lives. By capturing experience, affect, and action "in the moment" and with repeated measures, ESM approaches allow researchers…

This essay briefly describes some of the early AERA presidents who were empiricists, several of them directors of research, and how their work connects with some of the issues of design, measurement, analysis, and interpretation today. Beginning with the first president of AERA, a number of presidents through the late 1940s are highlighted, as…

The statistical method "meta-analysis" is perhaps unique as a contribution to empirical inquiry of many types because it arose entirely within the practice of education research. In spite of its origins, meta-analysis has found its widest application and most important contributions in the field of medicine. Contrasting the success of…

School-based evaluations of interventions are increasingly common in education research. Ideally, the results of these evaluations are used to make evidence-based policy decisions for students. However, it is difficult to make generalizations from these evaluations because the types of schools included in the studies are typically not selected…

Quantitative research on sexual minority youths (SMYs) has likely contributed to misperceptions about the risk and deviance of this population. In part because it often relies on self-reported data from population-based self-administered questionnaires, this research is susceptible to misclassification bias whereby youths who are not SMYs are…

Impact evaluation plays a critical role in determining whether federally funded research programs in science, technology, engineering, and mathematics are wise investments. This paper develops quantitative methods for program evaluation and applies this approach to a flagship National Science Foundation-funded education research program, Research…

In this technical comment, we argue that Morgan et al.'s claim that there is no minority overrepresentation in special education is in error due to (a) sampling considerations, (b) inadequate support from previous and current analyses, and (c) their failure to consider the complexities of special education disproportionality. [For Morgan et al.'s…

This brief documents the expansion of instructional specialist staffing in U.S. public school districts. We use data from the National Center of Education Statistics' annual Common Core of Data to chart staffing trends in public school districts between 1997-1998 and 2012-2013. The number of instructional specialists per 1,000 U.S students doubled…

Many of the methodological criticisms of the National Early Literacy Panel (NELP) report presented in this special issue of "Educational Researcher" are not specific to the NELP report but are in fact broad criticisms of much of the quantitative research on early literacy. This rejoinder demonstrates that these criticisms are off target and are…

How doctoral programs train future researchers in quantitative methods has important implications for the quality of scientifically based research in education. The purpose of this article, therefore, is to examine how quantitative methods are used in the literature and taught in doctoral programs. Evidence points to deficiencies in quantitative…

Howe's (2009) critique of positivistic tendencies in the education research community is valuable and pertinent. His analysis is nonetheless one-sided, finding fault with one side of current divisions alone. In an effort to retain the good points of his analysis, the author first summarizes Howe's argument, interpreting it as a critique of hasty…

This paper presents the author's response to commentaries by Eric Bredo, R. Burke Johnson, and Linda Tillman on his article "Positivist Dogmas, Rhetoric, and the Education Science Question." Each of the commentaries goes beyond merely characterizing and assessing the author's analysis to also suggest an alternative emphasis, if not an alternative…