In a clustered observational study, a treatment is assigned to groups and all units within the group are exposed to the treatment. We develop a new method for statistical adjustment in clustered observational studies using approximate balancing weights, a generalization of inverse propensity score weights that solve a convex optimization problem…

Systems for learning and producing knowledge, such as career and technical education (CTE), often reproduce inequities unless an equity-focused lens is used when designing, implementing, and evaluating programs. This framework presents guidance for conducting CTE research with an intentional focus on equity. Developed by the CTE Research Network's…

The visual analysis of data presented in time-series graphs are common in single-case design (SCD) research and applied practice in school psychology. A growing body of research suggests that visual analysts' ratings are often influenced by construct-irrelevant features including Y-axis truncation and compression of the number of data points per…

To conduct a multilevel meta-analysis of multiple single-case experimental design (SCED) studies, the individual participant data (IPD) can be analyzed in one or two stages. In the one-stage approach, a multilevel model is estimated based on the raw data. In the two-stage approach, an effect size is calculated for each participant and these effect…

The COVID-19 pandemic caused tremendous upheaval in schooling. In addition to its devasting effects on students' academic development, the disruptions to schooling had important consequences for researchers conducting effectiveness studies on educational programs during this era. Given the likelihood of future large-scale disruptions, it is…

N-of-1 trials, a special case of Single Case Experimental Designs (SCEDs), are prominent in clinical medical research and specifically psychiatry due to the growing significance of precision/personalized medicine. It is imperative that these clinical trials be conducted, and their data analyzed, using the highest standards to guard against threats…

Randomized control trials are considered the pinnacle for causal inference. In many cases, however, randomization of participants in social work research studies is not feasible or ethical. This paper introduces the co-twin control design study as an alternative quasi-experimental design to provide evidence of causal mechanisms when randomization…

Within the field of school psychology, we often put a premium on evidence-based practices, but what is often missing from these conversations is a consideration of replication and open science principles in the evaluation of evidence. Amid growing concerns regarding the replicability of psychological science, calls for greater research…

Accounting for complex interactions between contextual variables and learners' individual differences in aptitudes and background requires building the means to connect and access learner data at large scales, across time, and in multiple contexts. This paper describes the ASU Learning@Scale (L@S) project to develop a digital learning network…

In this article, Rachel Abenavoli, Natalia Rojas, Rebecca Unterman, Elise Cappella, Josh Wallack, and Pamela Morris argue that research-practice partnerships make it possible to rigorously study relevant policy questions in ways that would otherwise be infeasible. Randomized controlled trials of small-scale programs have shown us that early…

The COVID-19 outbreak emphasizes the need for alternative methods for data gathering and collaboration among researchers in a virtual research environment. One experimental design that is well suited in a social distancing research context is the single-case experimental design (SCD). SCDs can handle disruptions as: (a) they do not require large…

Single-case designs are a class of repeated measures experiments used to evaluate the effects of interventions for small or specialized populations, such as individuals with low-incidence disabilities. There has been growing interest in systematic reviews and syntheses of evidence from single-case designs, but there remains a need to further…

Literature addressing missing data handling for random coefficient models is particularly scant, and the few studies to date have focused on the fully conditional specification framework and "reverse random coefficient" imputation. Although it has not received much attention in the literature, a joint modeling strategy that uses random…

This article assesses the likely generalizability of educational treatment-effect estimates from regression discontinuity designs (RDDs) when treatment assignment is based on academic pretest scores. Our assessment uses data on outcome and pretest measures from six educational experiments, ranging from preschool through high school, to estimate…

The purpose of this study was to explain the variability in data collected from a single-case design study and to identify predictors of communicative outcomes for children with developmental delays or disabilities (n = 4). Using SAS® University Edition, we fit multilevel models with time nested within children. Children's level of baseline…