Group design studies in education include groups such as students, teachers, caregivers, schools, or districts assigned to conditions, typically treatment and control, to compare outcomes between the groups. Although the use of group designs in education has become more frequent and robust, the use of group designs in rural education lags far…

In this response to John Raven's "Diving in Where Angels Fear to Tread: Pre-Requisites to Evidence-Based Interventions," Stephen Gorard questions whether Raven's claims that researchers have created a serious threat to the entire earth, perhaps all of science, the process of education, and the field of psychology due to a lack of logic…

John Raven's article concerns the relationship between policy and evidence, what role that relationship plays in shaping the society in which we live, and what role researchers might play in shaping the relationship between policy and evidence. Although published in a "Psychology of Education Review", some of the examples draw beyond the…

Evidence-based education aims to support policy makers choosing between potential interventions. This rarely involves considering each in isolation; instead, sets of evidence regarding many potential policy interventions are considered. Filtering a set on any quantity measured with error risks the "winner's curse": conditional on…

The education field, these authors assert, often alternatively ignores, belittles, or "weaponizes" scientific findings and evidence relevant to education. They show examples of how education does a worse job than other fields at either rushing to apply approaches without enough evidence of effectiveness or…

In this commentary on John Raven's "Diving in Where Angels Fear to Tread: Pre-Requisites to Evidence-Based Interventions," Tommy MacKay discusses three examples that illustrate Raven's tendency to overstate or at least to over-simplify the issues raised in his paper and to present various views, approaches, or interventions as being…

Many processes and practices in the field of health professions education have been based more on tradition and assumption than on evidence and theory. As the field matures, researchers are increasingly seeking evidence to support various teaching and assessment methods. However, there is a tendency to focus on a limited set of topics, leaving…

In the "what works" agenda, the case for replication studies in education has strong proponents and supporting arguments. This paper outlines some of their key claims and argues that replication studies, whilst potentially making an important contribution to the "what works" and evidence-based agenda, and education more widely,…

John Raven has the capacity to see a bigger picture and highlight some of the causes of failures of that bigger picture. In barely 6000 words, he manages to outline several meta and micro-level problems that have led to the position he outlines regarding evidence-based interventions. This achievement should not be overlooked; what he has managed…

This protocol guided the review of research that informs the What Works Clearinghouse (WWC) practice guide entitled "Strategies for Postsecondary Students in Developmental Education -- A Practice Guide for College and University Administrators, Advisors, and Faculty." This protocol was used in conjunction with the "WWC Procedures…

In this paper, we explore Lawrence Stenhouse's provocation that too much research has been conducted for the world and not enough for the village. This provocation has taken on additional significance in contemporary global policy contexts where neoliberal systems of governance incorporate discourses of educational effectiveness, measurement,…

The need to find ways of ameliorating a number of what seemed to be gross abuses of 'science', logic, and authority in relation to educational policy emerged as a priority whilst revisiting writings on early childhood and elementary education. In the current paper, it is argued that many of these abuses stem from the uncritical acceptance of…

What role does scientific evidence play in educational practice? Supporters of evidence-based education (EBE) see it as a powerful way of improving the quality of public services which is readily applicable to the education sector. Academic scholarship, however, points out important limits to this applicability. I offer an account inspired by…

In John Raven's "Diving in Where Angels Fear to Tread: Pre-Requisites to Evidence-Based Interventions," he outlines several critical failings in which social scientists bear a responsibility for potentially a great deal of damage toward children, society, and notably, the planet itself. The nature of the damage appears to be one of…

This article addresses the gap between what works in research and what works in practice. Currently, research in evidence-based education policy and practice focuses on randomized controlled trials. These can support causal ascriptions ("It worked") but provide little basis for local effectiveness predictions ("It will work…