A recent issue of the Australian Journal of Language and Literacy included an article reporting on a systematic narrative review of the research literature that indicated that there was insufficient evidence to conclude whether genre theory and systemic functional linguistics either 'worked' or 'did not work'. The criteria used to evaluate these…

In educational research, the complexity of interventions and the diversity of contexts challenge the adequacy of existing reporting standards, primarily tailored for health interventions and randomised controlled trials. Recognising the critical need for appropriate tools to support education research, we developed two checklists: the CheckList Of…

Excellence in research is essential for advancing knowledge, fostering innovation, and addressing societal challenges. This article proposes the INDEX Strategy Framework as a structured, evidence-based guide to optimize the research process. The framework encompasses five critical phases: Identify Focus Areas, Network and Collaborate, Design…

Meta-analytic studies of second language (L2) learning typically employ a classic approach to meta-analysis. Although the classic approach can clarify findings, a multivariate, multilevel meta-analysis (3M) approach increases transparency by accounting for (a) dependencies in the evidence presented by primary studies, (b) methodological…

In 2020, the What Works Clearinghouse (WWC) for single-case experimental design (SCED) studies released an updated version of their standards and procedures handbook (Version 4.1). Because of these updates, there is a need to understand the implications for the field in terms of quality rating of the design, and subsequent synthesis of evidence at…

Group design studies in education include groups such as students, teachers, caregivers, schools, or districts assigned to conditions, typically treatment and control, to compare outcomes between the groups. Although the use of group designs in education has become more frequent and robust, the use of group designs in rural education lags far…

Scholarly efforts to identify core design features for effective teacher professional development have grown rapidly in the last 25 years. Many concise lists of design principles have emerged, most of which converge on a consensus of 5-7 presumably 'effective' features (e.g. collaborative tasks, active learning, focus on content). The…

Background/Context: When a researcher tests an educational program, product, or policy in a randomized controlled trial (RCT) and detects a significant effect on an outcome, the intervention is usually classified as something that "works." When the expected effects are not found, however, there is seldom an orderly and transparent…

Background/Context: Methodological background: Meta-analysis typically depends on the assumption that true effects follow the normal distribution. While assuming normality of effect "estimates" is often supported by a central limit theorem, normality for the distribution of interventions' "true" effects is a computational…

This innovative guide is now in a revised and expanded second edition with an even stronger applied focus. It helps educators harness the potential of single-case design (SCD) as a critical element of data-based decision making in a multi-tiered system of support (MTSS). The authors present simple and complex SCDs and demonstrate their use to…

The What Works Clearinghouse (WWC) identifies existing research on educational interventions, assesses the quality of the research, and summarizes and disseminates the evidence from studies that meet WWC standards. The WWC aims to provide enough information so educators can use the research to make informed decisions in their settings. This…

Single-case designs substantiate the effectiveness of interventions for people with disabilities and other populations through the repeated measurement of behavior over time. Consequently, employing accurate and reliable systems of measurement is critical to the validity of single-case designs. Much of the data in single-case research are…

Evidence-based assessment (EBA) requires that investigators employ scientific theories and research findings to guide decisions about what domains to measure, how and when to measure them, and how to make decisions and interpret results. To implement EBA, investigators need high-quality assessment tools along with evidence-based processes. We…

Background: The use of randomised controlled trials (RCTs) in education has increased significantly over the last 15 years. However, their use has also been subject to sustained and rather trenchant criticism from significant sections of the education research community. Key criticisms have included the claims that: it is not possible to undertake…

Based on their experiences from their work with two national initiatives designed to reform educational practice in U.S., the authors present seven guiding principles of evidence-based/informed educational policy and research to lay the foundation for making rigorous and comprehensive judgments about what evidence and scientific research designs…