Toward the goal of more rapid knowledge accumulation via better meta-analyses, this article explores statistical approaches intended to increase the precision and comparability of effect sizes from education research. The featured estimate of the proposed approach is a standardized mean difference effect size whose numerator is a mean difference…

Short comparative interrupted times series (CITS) designs are increasingly being used in education research to assess the effectiveness of school-level interventions. These designs can be implemented relatively inexpensively, often drawing on publicly available data on aggregate school performance. However, the validity of this approach hinges on…

The author of this commentary argues that physical scientists are attempting to advance knowledge in the so-called hard sciences, whereas education researchers are laboring to increase knowledge and understanding in an "extremely hard" but softer domain. Drawing on the work of Popper and Dewey, this commentary highlights the relative…

This article investigates the persistent and change elements of educational testing and assessment from 1920 to the present day. I show by examining the addresses and texts of American Educational Research Association presidents a continuing focus on schools, from early experiments and development up through applications in accountability systems.…

Survey responses collected via paper surveys and computer tablets were compared to test for differences between those methods of obtaining self-report data. College students (N = 258) were recruited in public campus locations and invited to complete identical surveys on either paper or iPad tablet. Only minor homogeneity differences were found…

Impact evaluation plays a critical role in determining whether federally funded research programs in science, technology, engineering, and mathematics are wise investments. This paper develops quantitative methods for program evaluation and applies this approach to a flagship National Science Foundation-funded education research program, Research…

The authors of this article consider how education researchers can improve school violence and school safety research by (a) examining gaps in theoretical, conceptual, and basic research on the phenomena of school violence; (b) reviewing key issues in the design and evaluation of evidence-based practices to prevent school violence; and (c)…

In this rejoinder to Willis, Smagorinsky, and Douglas, the authors discuss how many of the points raised by Willis and Smagorinsky regarding their original article, which appeared in the March 2009 issue of Educational Researcher, are concerned less with the methods themselves than with different styles of science. The authors of this rejoinder…

Education researchers, practitioners, and policymakers alike are committed to identifying interventions that teach students more effectively. Increased emphasis on evaluation and accountability has increased desire for sound evaluations of these interventions; and at the same time, school-level data have become increasingly available. This article…

Profiles a few of the affinities between pragmatists and scientific realists, and indicates a few dramatic differences dividing these schools of thought. Pragmatic research is driven by anticipated consequences. Scientific realists hope to find the truth about what the world is really like. (SLD)

Random samples of 50 articles each from the education and health-sciences literature are used to compare uses of quantitative evidence. Study designs and approaches in these fields are similar; thus no support is provided for the idea that educational research is less rigorous than that of the health sciences. (SLD)

The main differences between pragmatism and scientific realism seem to focus on the certainty of knowledge. Pragmatists contend that one can never be entirely certain of one's beliefs, whereas scientific realists argue that progress has been, and can be, made in explaining things about the world. (SLD)

In comparing several research and evaluation studies, the author contends that variation in outcomes may provide clues to valuable information. Five examples are used to illustrate how conflicting findings can be useful. (RLV)

Develops a metaphor of qualitative research as jazz to illuminate qualities that are embedded in the processes of qualitative inquiry. The jazz metaphor is said to create a pathway for making explicit the tacit understandings that permit qualitative research to flow and to be guided by the new findings and emerging understandings it uncovers. (GLR)

Identifies important criteria for assessing the quality of educational research and applies these 20 identified criteria to 2 recent international comparative studies in education, the Second International Science Study and the first International Assessment of Educational Progress. The major types of criteria are utility, propriety, and accuracy.…