Background: COVID-19 accentuated an evergreen dilemma in evidence-informed policy making--the imperative to synthesise the best available evidence with limited time to produce high quality synthesis. The pandemic prompted the adaptation of evidence synthesis practices to match the urgency of the crisis, and heightened demand by policy makers,…

I explore how "low-quality evidence" from program performance might still be useful in decision-making. Conceptually, a local government named "Here" is motivated to consider a program from "Elsewhere" that seems to show year-over-year exemplary performance. Here must manage five sources of uncertainty about whether…

Background: Knowledge brokering plays an important role in the evidence-to-policy system, but little is known about whether and how it occurs within government departments. Aims and objectives: Using empirical evidence from one UK government department, this article analyses how knowledge brokering takes place inside the policy making process and…

In evidence-based practice, new topics generally only have a few studies available for synthesis. As a result, the evidence of such meta-analyses raised substantial concerns. We investigated the robustness of the evidence from these earliest studies. Real-world data from the Cochrane Database of Systematic Reviews (CDSR) were collected. We…

Previous research has identified contradictory patterns in autism upon probabilistic reasoning tasks, and high levels of self-report paranoia symptoms have also been reported. To explore this relationship, the present study assessed 64 non-autistic and 39 autistic adults on two variants of a probabilistic reasoning task which examined the amount…

Background: To improve the use of evidence in policy and practice, many organisations and individuals seek to promote research-policy engagement activities, but little is known about what works. Aims and objectives: We sought (a) to identify existing research-policy engagement activities, and (b) evidence on impacts of these activities on research…

With technological advances, institutional stakeholders are considering evidence-based developments such as Curriculum Analytics (CA) to reflect on curriculum and its impact on student learning, dropouts, program quality, and overall educational effectiveness. However, little is known about the CA state of the art in Higher Education Institutions…

Outcomes of meta-analyses are increasingly used to inform evidence-based decision making in various research fields. However, a number of recent studies have reported rapid temporal changes in magnitude and significance of the reported effects which could make policy-relevant recommendations from meta-analyses to quickly go out of date. We…

Purpose: School leaders are critical to organizational change and school improvement, particularly through their role in facilitating teacher development. Yet the literature is thin regarding the extent to which various sources of evidence influence school leaders' decisions and regarding conditions that may shape differences in school leader…

Schools are a critical setting to promote healthy youth development through the provision of evidence-based programs (EBPs), yet preventive EBPs in schools are underutilized. The Exploration, Preparation, Implementation, Sustainment (EPIS) framework highlights numerous factors that may influence program adoption during the Exploration phase and…

We explore ways in which statistics can be used to understand disease spread and support decision-making by governments. "Past performance does not guarantee future results"--we hope. We discuss and show examples from the National Science Foundation (NSF)-funded COVID-Inspired Data Science Education through Epidemiology (CIDSEE) project.…

Background: Brokers, intermediaries, and boundary spanners (BIBS) bridge research and policy or practice, and can elevate the role of evidence in decision making. However, there is limited integration of the literature across different sectors to understand the strategies that BIBS use, the skills needed to carry out these strategies, and the…

We empirically examined the effectiveness of how the Analysis of Competing Hypotheses (ACH) technique structures task information to help reduce confirmation bias (Study 1) and the portrayal of intelligence analysts as suffering from such bias (Study 2). Study 1 (N = 161) showed that individuals presented with hypotheses in rows and evidence items…

Adapting interventions based on learner progress is paramount to the effectiveness of interventions in special education and applied behavior analysis. Although there is some research on effective methods for training practitioners to make general instructional decisions (e.g., modify an intervention) based on graphed performance data, research on…

Risk of bias (RoB) assessments are a core element of evidence synthesis but can be time consuming and subjective. We aimed to develop a decision rule-based algorithm for RoB assessment of seroprevalence studies. We developed the SeroTracker-RoB algorithm. The algorithm derives seven objective and two subjective critical appraisal items from the…