Purpose: Multisite mediation studies are a cornerstone in mapping out developmental processes because they probe the mechanisms of a treatment while creating key opportunities to learn from and about variation in those mechanisms across sites. Despite the prevalence of multisite studies, a significant gap in the literature is how to plan such…

The Research-Aligned Mentorship (RAM) program at Farmingdale State College is changing the trajectories of racial minority students, students of low socioeconomic status, and first-generation undergraduate students. This article reviews the RAM program from 2016 through 2022. During that period, Farmingdale welcomed seven cohorts of RAM Scholars,…

Cluster-randomized trials have been widely used to evaluate the treatment effects of interventions on student outcomes. When interventions are implemented by teachers, researchers need to account for the nested structure in schools (i.e., students are nested within teachers nested within schools). Schools usually have a very limited number of…

Psychologists are emphasizing the importance of predictive conclusions. Machine learning methods, such as supervised neural networks, have been used in psychological studies as they naturally fit prediction tasks. However, we are concerned about whether neural networks fitted with random datasets (i.e., datasets where there is no relationship…

Most randomized field experiments experience some attrition. Moreover, the extent of attrition may differ by treatment condition in systematic, non-random ways, biasing estimates of treatment effects and contributing to invalid inferences. We address concerns about non-random attrition by quantifying the conditions necessary in the attritted data…

There has been increased focus within the evaluation field on the value of community-engaged research (CER) methods; however, CER is not easily seen as compatible with experimental evaluation methods (or randomized controlled trial, RCT). For instance, in an experimental design, researchers leverage randomization to create a counterfactual; this…

Fully-Latent Principal Stratification (FLPS) offers a promising approach for estimating treatment effect heterogeneity based on patterns of students' interactions with Intelligent Tutoring Systems (ITSs). However, FLPS relies on correctly specified models. In addition, multiple latent variables, such as ability, participation, and epistemic…

Meta-analyses of treatment effects in randomized control trials are often faced with the problem of missing information required to calculate effect sizes and their sampling variances. Particularly, correlations between pre- and posttest scores are frequently not available. As an ad-hoc solution, researchers impute a constant value for the missing…

This article provides an introduction to randomized response polling, a technique which was designed to allow for questioning on sensitive issues while protecting the respondent's privacy and avoiding social desirability bias. It is described in terms that are suitable for presentation and use in any classroom environment. Instructions for plain…

Increasing integrity concerns in medical research have prompted the development of tools to detect untrustworthy studies. Existing tools primarily assess published aggregate data (AD), though scrutiny of individual participant data (IPD) is often required to detect trustworthiness issues. Thus, we developed the IPD Integrity Tool for detecting…

Implementation of evidence-based practices for autistic students must be informed by robust research literature. Randomized-controlled trials (RCTs) are often considered a "gold standard" methodology for determining the effectiveness of interventions. However, the complex nature of schools presents challenges for implementing successful…

Evidence synthesis findings depend on the assumption that the included studies follow good clinical practice and results are not fabricated or false. Studies which are problematic due to scientific misconduct, poor research practice, or honest error may distort evidence synthesis findings. Authors of evidence synthesis need transparent mechanisms…

Background: Power analyses for a cluster-randomized trial (CRT) require estimates of additional design parameters beyond those needed for an individually randomized trial. In a 2-level CRT, there are two sample sizes, the number of clusters and the number of individuals per cluster. The intraclass correlation (ICC), or the proportion of variance…

Little research has been conducted to assess which specific databases should be searched when performing a systematic review (SR) on acupuncture. The current study aimed to identify key databases and the optimal database combination to retrieve randomized controlled trials (RCTs) on acupuncture for inclusion in SRs. A systematic search for SRs in…

Random encouragement designs evaluate treatments that aim to increase participation in a program or activity. These randomized controlled trials (RCTs) can also assess the mediated effects of participation itself on longer term outcomes using a complier average causal effect (CACE) estimation framework. This article considers power analysis…