Randomized experiments are a strong design for establishing impact evidence because the random assignment mechanism theoretically allows confidence in attributing group differences to the intervention. Growth of randomized experiments within educational studies has been widely documented. However, randomized experiments within education have…

In this article John Raven responds to commentaries on his article, "Diving in Where Angels Fear to Tread: Pre-Requisites to Evidence-Based Interventions" (EJ1248321). Herein, he provides dialogues with individual authors that relate closely to his original theme and which seemed to merit further elaboration. He briefly addresses: (1)…

What do we actually do when we research education policy and governance? Why do we tame the messy hinterland of research into smooth accounts and what do we lose in the process? In this volume, distinguished scholars in education policy and governance research discuss how the practice of methods is messy, subjective, and provisional. They approach…

John Raven's article concerns the relationship between policy and evidence, what role that relationship plays in shaping the society in which we live, and what role researchers might play in shaping the relationship between policy and evidence. Although published in a "Psychology of Education Review", some of the examples draw beyond the…

In John Raven's "Diving in Where Angels Fear to Tread: Pre-Requisites to Evidence-Based Interventions," he outlines several critical failings in which social scientists bear a responsibility for potentially a great deal of damage toward children, society, and notably, the planet itself. The nature of the damage appears to be one of…

Evidence-based education aims to support policy makers choosing between potential interventions. This rarely involves considering each in isolation; instead, sets of evidence regarding many potential policy interventions are considered. Filtering a set on any quantity measured with error risks the "winner's curse": conditional on…

In the complex world of educational policy, causal inferences will be debated. As we review non-experimental designs in educational policy, we focus on how to clarify and focus the terms of debate. We begin by presenting the potential outcomes/counterfactual framework and then describe approximations to the counterfactual generated from the…

Qualitative research (QR) has gained visibility and acceptance in the field of special education due to early efforts to identify quality indicators focused on technical and methodological aspects of QR. Whereas these indicators focused on credibility and trustworthiness of data, this article articulates additional QR quality indicators to enhance…

Education policy makers must make decisions under uncertainty. Thus, how they think about risks has important implications for resource allocation, interventions, innovation, and the information that is provided to the public. In this policy brief we illustrate how the standard of evidence for making decisions can be quite inconsistently applied,…

Panel data methods, which include difference-in-differences and comparative interrupted time series, have become increasingly common in education policy research. The key idea is to use variation across time and space (e.g., school districts) to estimate the effects of policy or programmatic changes that happen in some localities but not others.…

Panel data methods, which include difference-in-differences and comparative interrupted time series, have become increasingly com- mon in education policy research. The key idea is to use variation across time and space (e.g., school districts) to estimate the effects of policy or programmatic changes that happen in some localities but not others.…

Research on disproportionate representation in special education has potential to influence policy in ways that rectify educational inequities. In this study, we investigated how disproportionality researchers have operationalized dis-ability, identified key themes and theories used in disproportionality research, and evaluated the coherence…

The puzzle of how to connect research with policy and practice is a vital area for scientific inquiry. The William T. Grant Foundation believes that attempts to improve the use of research evidence in policy and practice should be subject to rigorous theory building and empirical analysis. The stakes are high for the research community: If we do…

While scholars develop research with clear implications for policy and practice, this work has been largely ineffective in influencing thought beyond the academy. In this article, we explore challenges researchers face in designing public scholarship to influence policy. To illustrate, we profile one such effort, the "Opportunity to Learn…

Qualitative interviews can be enhanced through using creative methods within them to prompt discussion and conversation. The research project upon which this case focuses sought to explore the space between policy and practice in pre-entry widening participation work in universities. This is an area where often people focus on telling you about…